Across-speaker articulatory reconstruction from sensorimotor cortex for generalizable brain-computer interfaces

preprint OA: gold CC-BY-4.0
📄 Open PDF Full text JSON View at publisher
Full text 59,641 characters · extracted from oa-pdf · 8 sections · click to expand

Abstract

Objec&ve: Speech brain-computer interface s (BCIs) can restore speech features like arHculatory movements from brain acHvity. However, for individuals with vocal tract paralysis, lack of arHculatory movements can pose a challenge for speech BCI development. To address this challenge, our study aims at extracHng generalizable arHculatory features from a group of naHve Dutch speakers and reconstrucHng these features from brain data of a separate group of able-bodied individuals. Approach: We applied a tensor component analysis (TCA) model to extract generalisable arHculatory features from a publicly available arHculatory movement dataset. To reconstruct arHculatory features from the brain, we analyzed data of three able-bodied parHcipants P1, P2 and P3 with high-density electrocorHcography (HD-ECoG) electrode arrays implanted over the sensorimotor cortex. For each parHcipant, a separate TCA model was applied to extract neural features. A gradient boosHng regression model was used to reconstruct arHculatory features from neural features. ReconstrucHon performance was measured as Pearson’s correlaHon coefficient (PCC) between the reconstructed and the generalizable arHculatory features. Results: The extracted arHculatory features showed even contribuHons across parHcipants, indicaHng that these features captured generalizable arHculatory kinemaHc pa\erns . By using these features, we were able to reconstruct arHculatory features from brain data. PCC between the reconstructed and original arHculatory features were significantly above chance for all three parHcipants, with mean PCCs of 0.80, 0.75 and 0.76 for P1, P2 and P3 respecHvely. Significance: With the rapid development of speech BCI, our research demonstrates that speech - related arHculatory features can be restored from HD-ECoG signal using generalizable arHculatory features derived from able -bodied individuals. With the potenHal to reconstruct audio or speech - related facial movements from the re constructed arHculatory features, our framework may provide a new way for developing speech BCIs for people unable to produce mouth movements . .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Introduc)on To produce speech, our brain coordinates the movement of vocal tract muscles , referred to as speech arHculators: lips, jaw, tongue, and larynx (Browman & Goldstein, 1992; CharHer et al., 2018; Silva et al., 2024) . Due to motor impairments caused by medical condiHons such as amyotrophic lateral sclerosis (ALS) or brain stem stroke, some people may lose the ability to control their vocal tract muscles to produce speech. The loss of speech can lead to barriers in social li fe and substanHally impact life quality (Walshe & Miller, 2011). Brain-computer interface s (BCIs) may be able to help these people by restoring their communicaHon ability. This can be done, for example, by converHng neural signals from brain areas involved in speech producHon to text on computer display or synthesized speech as has been shown in several individuals (Silva et al., 2024). However, it is unclear how generalizable these BCIs are across people. Also, these BCIs require a lot of data to train the decoding model. Most speech BCIs use signal from the ventral sensorimotor cortex (vSMC), where arHculatory kinemaHcs informaHon is strongly encoded (CharHer et al., 2018; Mugler et al., 2018). Therefore, reconstrucHng the intermediate arHculatory movement features is a logical approach for speech BCIs. Recent BCI applicaHons have demonstrated successful speech synthesis from arHculatory features reconstructed from limited neural signals (Anumanchipalli et al., 2019; Metzger et al., 2023). Accurate reconstrucHon of vocal tract and facial movement has also led to a successful implementaHon of a digital facial avatar that a person with motor impairment c ould use for enhancing communicaHon and self -expression (Metzger et al., 2023). So far, research has been focusing on connecHng brain signals to arHculaHon in the same individuals who retain their ability to control their vocal tract muscles to some extent. However, people who suffer from severe vocal tract paralysis may completely lose the ability to control vocal tract muscles and cannot produce any speech- movement or sound (Duffy, 2012). For these people, no arHculatory or acousHc data are available to train BCI decoding models . For individuals unable to produce any speech movements, transfer learning could provide a soluHon for developing arHculaHon-based speech-BCIs. Transfer learning applies knowledge learned from one dataset to a different but related dataset (Jayaram et al., 2016; Weiss et al., 2016). In the context of speech-BCIs, transfer learning can be used to extract arHculatory features shared across healthy individuals and then map them onto the brain acHvity of individuals with vocal tract paralysis. Two key research quesHons underlie the integraHon of speech-BCIs with transfer learning: (1) given individual variaHon in vocal tract anatomy, is it possible to extract generalizable arHculatory features across healthy parHcipants? (2) is it possible to reconstruct generalizable arHculatory features from brain acHvity of a different group of individuals? To address these quesHons, we developed a novel BCI framework that extracts generalizable arHculatory features across healthy parHcipants and reconstructs them from brain data collected from a separate group of parHcipants without using their own arHculatory movement data. We use d a tensor component analysis (TCA) model to extract generalizable arHculatory features (Kolda & Bader, 2009; Williams et al., 2018). We then used a gradient boosHng regression model to reconstruct the arHculatory features from high-density ECoG (HD-ECoG) data of three different parHcipants, unseen by the TCA model. We show that the arHculatory features can be reconstructed from HD-ECoG with a significant Pearson’s correlaHon with the original arHculatory features , which demonstrates the possibility of cross-parHcipants arHculatory-brain mappings . Our result highlights the potenHal of the novel framework for developing generalizable BCI models that could facilitate speech reconstrucHon in people with vocal tract paralysis. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint

Materials and methods

Electromagne,c ar,culography (EMA) dataset We used arHculatory movement s recorded during word producHon from a publicly available Electromagne-c Ar-culography (EMA) dataset (Wieling et al., 2016). The EMA data was collected by a portable 16-channel device (WAVE, Northern Digital InC.) at a sampling rate of 100 Hz during a word producHon experiment. A total of 21 speakers of the Low-Saxon Dutch dialect and 19 speakers of the Central Dutch dialect parHcipated in the word producHon experiment. During the experiment, parHcipants performed two tasks. Task I was a picture naming task, in which parHcipants were presented with 70 pictures of objects sequenHally and were instructed to nam e the objects out loud in their dialect. Task II was a consonant-vowel-consonant ( CVC) sequences reading task, in which parHcipants were presented with 27 CVC sequences on screen sequenHally and were instructed to read them out loud in the standard Dutch dialect (Figure 1a). Therefore, the sHmuli included 97 Dutch words in total (70 object names and 27 CVC sequences). SHmuli in both tasks were repeated twice in random order. For both tasks seven EMA sensors were a\ached to jaw, lower lip (LL), right corner of the lip (right lip, RL), upper lip (UL), tongue Hp (TT), tongue body (TB) and tongue dorsal (TD) posiHons, to track movements of the corresponding arHculator along three dimensions: up-down, anterior- posterior and lem-right direcHons (Figure 2). PosiHons in the lem-right direcHon were excluded from all analyses because speech movement are typically symmetrical and provide li\le extra informaHon. We confirmed this with an analysis of variance a long each direcHon, where scores for the lem -right direcHon for tongue was very low (Table S1). The Hmestamps with pronunciaHon onset and offset of each word were included in the dataset. Figure 1. Experimental paradigms of EMA and HD -ECoG data collec>on. a. During task I of the EMA data collec8on, par8cipants were presented with pictures of objects (70 in total) and were instructed to name them. During task II, par8cipants were asked to read consonant -vowel-consonant (CVC) sequences (27 in total) presented on screen. Every picture/ CVC sequence was repeated twice in random order. This figure was adapted from images provided by Prof. Dr. Wieling, used with permission from the author. b. During the HD-ECoG data collec8on, par8cipants were presented with words from the same set of 70 object names and 27 CVC sequences (97 Dutch words in total) used in the EMA experiment. Unlike the EMA experiment, all words were presented in textual form. The task trial dura8on was 2 seconds for P1 and P2, and 1.8 seconds for P3. The dura8on of inter- trial-interval was 1.2 sec onds for P1 and P2, and 1.8 sec onds for P3. Dutch words shown in the figure: bal (ball), bijl (axe), taak (task), paak (CVC leXer sequence, not a real Dutch word), tor(beetle). .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Figure 2. SagiAal view of loca>ons of EMA sensors. Each sensor loca8on is marked with a sphere, and the corresponding label is shown. There was one EMA sensor placed per loca8on: jaw, lower lip, right lip, upper lip, tongue 8p, tongue body and tongue dorsal loca8ons to track movements of each corresponding ar8culator in three direc8ons anterior-posterior (X-axis), up-down (Y-axis), and le[-right (Z-axis) direc8ons. In our study, we only included data collected from parHcipants speaking the Central Dutch dialect , given its greater similarity with the standard Dutch compared to the Low -Saxon Dutch dialect , as evidenced by a shorter Levenshtein distance (Heeringa, 2004). To ensure a consistent number of trials and comparable arHculator movement amplitude , we addiHonally excluded data from two Central Dutch parHcipants with missing trials , eight parHcipants with interrupted trials and one parHcipant with excepHonally large mouth movements (large amplitude of EMA signal s beyond the range of mean±2.5*std ). EMA data from eight remaining parHcipants (U1 to U8) were included in our analyses. HD-ECoG dataset Par$cipants Three male parHcipants (P1, P2, P3, age 31, 26, and 40, respecHvely) were admi\ed to the University Medical Centre Utrecht for diagnosHcs and treatment of medicaHon-resistant epilepsy or brain tumour. Two parHcipants (P1 and P2) underwent clinical ECoG implantaHon for epilepsy diagnosHc procedures and one parHcipant (P3) underwent electrode implantaHon during awake tumour resecHon surgery. All parHcipants provided wri\en informed consent for implantaHon of a high -density ECoG grid for research purposes. The protocols were approved by the Medical Ethical Commi\ee of the University Medical Cent re Utrecht in accordance with the DeclaraHon of Helsinki (20 24). All parHcipants consented to use of an high-density (HD) ECoG grid over the somatosensory cortex, which for P1 and P2 was implanted in addiHon to standard clinical grids with low density configuraHon. Here, we only focused on the HD-ECoG grids. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Data acquisi$on All three parHcipants were implanted with a HD-ECoG grid over the sensorimotor cortex on the lem hemisphere (Figure 3) , with different configuraHons (Table 1). HD-ECoG signals were recorded at a sampling rate of 2000 Hz for P1 and P3 (Blackrock Microsystems LLC, Salt Lake City, USA), and at 2048 Hz for P2 (Micromed, Treviso, Italy). For P1 and P3 , audio recordings were recorded by a microphone connected to the neural recording system during the task. For P2, audio recordings were obtained with a separate microphone installed in the parHcipant’s room. All audio recordings were recorded at a sampling rate or 30000 Hz. For P1 and P3, the audio was recorded by Blackrock and was automaHcally synchronised with brain data. For P2, the audio was recorded by the PresentaHon® somware (Version 23.0, Neurobehavioral Systems, Inc., Berkeley, CA, www.neurobs.com) on the sHmulus presentaHon computer and was manually synchronised with brain data based on the PresentaHon log. Figure 3. Loca>ons of high-density (HD)-ECoG grid electrodes. High-density ECoG grids were implanted over the sensorimotor cortex on the le[ hemisphere. In P3, the HD grid was partly on top of another small grid blocking signals. These electrodes were removed from all analyses (marked by red crosses). The yellow lines indicate the loca8on of the central sulcus. Table 1. HD-ECoG configura>ons across par>cipants. ParHcipant Number of electrodes Inter-electrode distance (IED) Exposed diameter P1 128 3 mm 1 mm P2 32 4 mm 1 mm P3 96 3 mm 1 mm Experimental procedures PresentaHon® somware (Version 23.0, Neurobehavioral Systems, Inc., Berkeley, CA, www.neurobs.com) was used to run the experiment s for P1 and P2, and PyQT (h\ps://wiki.python.org/moin/PyQt) was used to run the experiment for P3. As in the EMA experiment, all HD-ECoG parHcipants were instructed to read out the same 97 Dutch words, including 70 object names from the picture naming task and 27 CVC sequences from the CVC sequence reading task. However, unlike the picture naming task in the EMA experimen t, all words in the HD-ECoG experiment were presented to parHcipants in textual form to avoid visual responses evoked by pictures (Figure 1b). All words were presented in random order and each word appeared on the screen twice. The duraHon of word trials and the inter-trial interval varied across parHcipants as P3 performed the task in the operaHng room , where Hme for research was limited . Thus, in P1 and P2 , the duraHon of a word trial was 2 seconds, and the duraHon of an inter-trial interval was 1.2 seconds. In P3, both the word trial and the inter-trial interval had a duraHon of 1.8 seconds. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Data Analysis The data analysis framework (Figure 4) consists of two pipelines: the EMA analysis pipeline and the HD-ECoG analysis pipeline. Each pipeline includes three steps: data preprocessing, tensor construcHon, and feature extracHon. From these steps , we obtained arHculatory features extracted from the EMA tensor and neural features extracted from the HD -ECoG tensor. We then used these features for the arHculatory feature reconstrucHon. Figure 4. The framework for ar>culatory fea ture reconstruc>on from HD-ECoG signals. The le[ panel shows the analysis pipeline of the EMA and the right panel shows the analysis pipeline of the HD-ECoG dataset. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint EMA data preprocessing and tensor construc$on First, we idenHfied missing value s in the EMA data for each parHcipant (U1: 1.35%, U2: 1.14%, U3: 0.16%, U4: 0.41%, U5: 0.71%, U6: 0.35%, U7: 0.42%, U8: 0.51%). Missing values were imputed using linear interpolaHon available in the Pandas library of Python (h\ps://pandas.pydata.org). Then, EMA data were smoothed with a 5th -order, 20 Hz low-pass Bu\erworth filter. Amer that, EMA data in the lem-right direcHon (z-axis) were excluded. We then removed baseline from the remaining EMA data by subtracHng the mean posiHons for each combinaHon of arHculator and direcHon during a separate 10- second rest period, in which parHcipants were asked to refrain from speaking or swallowing (Wieling et al., 2016). Amer preprocessing, we segmented EMA data by using the Hme window from 0 to 1 second around the speech onset for each word trial and obtained a three-dimensional tensor : 100 x 14 x 194, which corresponds to 100 Hme points, 14 combinaHons of arHculators (7) and direcHons (2), and 194 word trials (97 unique words repeated twice) for each parHcipant. We then concatenated these tensors across parHcipants and obtained a four-dimensional tensor (8 x 100 x 14 x194). We experimented with shiming the Hme window around the speech onset (prior to speech onset) and different window sizes, but the current Hme window contained the most informaHon . HD-ECoG data preprocessing, channel selec$on and tensor construc$on The HD-ECoG data analysis pipeline was applied to each HD-ECoG parHcipant’s dataset. First, we visually inspected if there were channels with noisy or flat signals in the data. No channel was removed during this step for any of the parHcipants. We then removed 14 channels in P3 because of they lay on top of another grid and therefore were not recording signals directly from the brain Hssue (Figure 3). Next, for each remaining channel, line noise (50Hz and its harmonics) was removed with a notch filter. Common average referencing was then applied to remove common noise and trends , and HD-ECoG signals were downsampled to 512 Hz. Amer that, for each channel high frequency band (HFB; 60-170 Hz) signals were extracted in 1 Hz bins using Morlet wavelet decomposiHon and were averaged across frequency bins. HFB signals were then log-transformed and downsampled to 100 Hz to match the sampling rate of EMA . Finally, for each channel, the resulHng HFB signals were baseline-corrected by subtracHng the mean value s of a 10-second rest period before the first word trial. The speech onset moments were detected by Azure speech -to-text service (h\ps://learn.microsom.com/en -us/azure/ai-services/speech-service/fast-transcripHon- create?tabs=locale-specified) and manually corrected using Praat (Boersma, 2001) . We used the Hme window from 0.25 sec before to 0.75 sec amer speech onset to segment conHnuous recordings into word trials. The window starHng at 0.25 s before speech onset captured all informaHon of the first phoneme in the sensorimotor cortex and has been shown to produce opHmal decoding results in previous studies (Jiang et al., 2016; Ramsey et al., 2018). The 1 second window length captured the arHculatory movements of most words (95 percenHle of the distribuHon of word duraHons: 0.69 sec). Rest trials were composed of 1 second of data starHng amer the end of the preceding word trial. We idenHfied channels with significant responses to the task by comparing the mean HFB acHvity between speech and silence using a two-tailed paired t-test. Since most channels showed very significant p- values (p0.8, corresponding to a t- value of 12.44) to ensure only the most robust task-specific acHvaHon were included. The selected channels are referred to as acHve channels in subsequent analysis. Amer channel selecHon, we constructed a three-dimensional tensor (100 x the number of selected channels x 194) for each HD-ECoG parHcipant. Unlike the EMA analysis, we did not concatenate the HD-ECoG tensors across parHcipants to construct a four-dimensional tensor, as the channel dimension differed across parHcipants in number, locaHon and electrode spacing (Figure 3 and Table 1). .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Feature extrac$on Tensor component analysis Tensor decomposiHon was applied to extract a set of matrices . Vectors within these matrices are referred to as components. Individual component captures the variability along each dimension. We analyzed the characterisHcs of these components quanHtaHvely and qualitaHvely. The tensor decomposiHon and characterisHcs analysis are referred to as tensor component analysis (TCA) (Williams et al., 2018). CANDECOMP/PARAFAC decomposiHon is one of the most commonly used tensor decomposiHon

Method

s (Kolda & Bader, 2009). An n-dimensional tensor 𝑋 ∈ ℝ!!× !" × ⋯ × !# is decomposed into the combinaHon of R components and can be approximated by, 𝑋 ≈ ∑ 𝑎% ∘ 𝑏% ∘ 𝑐% ∘ ⋯ ∘ 𝑛% & %'( , where ∘ is the outer product , and 𝑎% ∈ 𝑖( , 𝑏% ∈ 𝑖) , … , 𝑛% (𝑟 = 1, ⋯ , 𝑅) are component s, which are the rth columns of the factor m atrices 𝐴, 𝐵, ⋯ 𝑁, respecHvely. Elements in each factor matrix are factor loadings. The CANDECOMP/PARAFAC decomposiHon procedure is omen opHmized by the alternaHng least squares method . This method has two steps. The first is to iniHalize factor matrices randomly or by certain criteria. The second step is t o opHmize one factor matrix at a Hme while keeping the others fixed. The opHmizaHon is achieved by minimizing the objecHve funcHon between the original tensor and the approximated tensor. For example, when opHmizing factor matri x 𝐴, we have the objecHve funcHon, 𝐴 ← ∑(𝑋 − ∑ 𝑎%; ∘ 𝑏% ∘ 𝑐% ∘ ⋯ ∘ 𝑛% & %'( )*+ ,%-.!/ , in which the minimizaHon is a linear -square matrix problem . All factor matrices are opHmized iteraHvely. When opHmizing each factor matrix, this procedure is iterated unHl the objecHve funcHon converges or the number of iteraHons reaches a pre-set threshold. EMA tensor decomposi&on and ar&culatory feature extrac&on We used the nonnegaHve CANDECOMP/PARAFAC decomposiHon opHmized by hierarchical alternaHng least squares to decompose the EMA tensor. The decomposiHon pipeline was implemented using the Python library tensortools (Williams et al., 2018). Amer applying the nonnegaHve CANDECOMP/PARAFAC decomposiHon, t he EMA tensor was decomposed into 29 components and four factor matrices: the parHcipant factor, Hme factor, arHculator-by-direcHon factor and word trial factor. The decomposiHon process was repeated four Hmes and resulted in four TCA runs with consistent results across the runs (Figure S3). We then checked the goodness-of-fit by inspecHng the cumulaHve explained variance of all 29 components, which was 0.89 averaged across four runs (Figure 5a). Adding more components did not substanHally increase the explained variance. To reduce components , we first selected components by the run with the highest explained variance. Since the explained variance of the first component was over 75%, we used the mean explained variance from the 2 nd to the 29 th component as the threshold to determine the number of components to select. The 10 th component was the last component with an explained variance above this threshold. Therefore, we only retained the first 10 components (Figure 5b). In the next step, our goal was to select components that generalized across all parHcipants. To measure the .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint generalizability of each component, we calculate the commonality value of each component in the parHcipant factor as following (Hurley & Rickard, 2009; Williams et al., 2018), com(𝑎%) = (∑ 𝑎%! ))0 !'( ∑ 𝑎% ! )0 !'( In which 𝑎% is the r th component in the parHcipant factor matrix and 𝑎%! is the i th element in that component. The commonality value reflects how many parHcipants have similar factor loadings, i.e., how many parHcipants contribute similarly to a component. If all parHcipants have similar factor loadings, the commonality of this component equals the number of parHcipants. In contrast, if only one parHcipant has a non-zero factor loading, the commonality of this component equals 1, indicaHng that only that parHcipant contributes to this component . We permuted elements across components 1000 Hmes to simulate the distribuHon of commonality (Figure 5c). Figure 5d shows examples of a component with high commonality and a component with low commonality. We used the mean commonality (4.57) as the threshold, as this value indicates that more than half of eight parHcipants contributed equally to the component . Using a h igher threshold yields too few features and could compromise reconstrucHon performance. By using this threshold, six components with commonality above it were selected for further analyses. We refer to selected components in these factor matrices as features. Specifically, in our reconstrucHon analysis, we refer to features from the word trial factor as the arHculatory features. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Figure 5. Tensor component selec>on in the EMA dataset . a. Cumula8ve explained variance of all 29 tensor components averaged across 4 runs. b. Explained variance per component (star8ng from component 2 since component 1 explained approximately 80% explained variance) averaged across 4 runs. The mean explained variance was indicated by the red line and used as the threshold for component pre-selec8on. Component 10th is the last component with an explained variance above the threshold . c. The simulated distribu8on of commonality obtained by permu8ng factor loadings across the 29 components. The red doXed line indicates the mean commonality of the simulated distribu8on. d. Examples of a component with high commonality and a component with low commonality, which was 7.93 and 3.03, respec8vely HD-ECoG tensor decomposi&on and neural feature extrac&on As in the arHculatory feature extracHon, we extracted features from the HD-ECoG tensors by using the nonnegaHve CANDECOMP/PARAFAC decomposiHon opHmized by hierarchical alternaHng least squares. The HD-ECoG tensor s were decomposed into 10, 14, and 17 components for P1, P2, and P3, respecHvely, corresponding to 80% explained variance. We chose 80% explained variance as the cut- off point for model fiyng because adding more components did not increase the explained variance substanHally. To select reproducible features across repeHHons, we used Pearson’s correlaHon coefficient (PCC) between word trial factor loadings to select components . Since HD-ECoG tensor decomposiHon yield less components than EMA tensor, only one-step component selecHon is needed . First, we shuffled word trial loadings across components 1000 Hmes and calculated PCC between repeHHons for all components . Figure 6 shows the distribuHon of PCC of word trial factors between repeHHons for each HD-ECoG parHcipant. We calculated the 95th percenHle of the distribuHon and used it to select components with PCC above this threshold from the word trial factor as neural features. This resulted in 7, 6, and 6 components for parHcipants P1, P2, and P3, respecHvely. The mean PCC of extracted components between repeHHons was 0.59 for P1, 0.30 for P2 and 0.49 for P3. As in the EMA analysis, we combined vectors from the selected components to create a factor matrix for each dimension of the HD-ECoG tensor. We obtained three factor matrices: the channel factor, the Hme factor, and the word factor, which captured spaHal, temporal, and kinemaHc variaHons across words in neural acHvity, respecHvely. We also refer to components from these factor matrices as features. In our reconstrucHon analysis, features from the word trial factor matrix are referred to as the neural features. Figure 6. Selec-on of neural features in the HD-ECoG data. The panels show the distribuHons of PCC of word factors between word repeHHons across all components over 1000 shuffles for HD-ECoG parHcipants P1, P2, and P3, respecHvely. The significance threshold (α=0.05) (indicated by the green do\ed line, which represents the 95th percenHle of the distribuHon) of each distribuHon was 0.33, 0.17, and 0.31 for parHcipant P1, P2 and P3, respecHvely. We selected components with a PCC above these thresholds. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Generalisable ar,culatory feature reconstruc,on from neural features To capture the complex relaHonships between neural data and arHculatory data, we used the gradient boosHng regression model to reconstruct the generalisable arHculatory features from the neural features (Friedman, 2001; 2002; HasHe, 2009) . This model was chosen for its robust performance on small datasets so that overfiyng can be avoided . ReconstrucHon performance was evaluated by the PCC between the reconstructed and original arHculatory features and was cross-validated across all words using the leave-one-word-out scheme . We used the permutaHon test to determine the significance of reported PCC values by shuffling word labels of all trials 1000 Hmes. PermutaHon was performed on data of repeHHon 1 and repeHHon 2 separately. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint

Results

HD-ECoG channel selec,on For P1, P2, and P3, respecHvely, 19.5% (25/128), 75% (24/32) and 25.6% (21/82) of HD-ECoG channels showed very strong HFB increases during word trials. These channels were referred to as acHve channels (Figure 7). Figure 7. T-value maps comparing high-frequency band (HFB) responses during speech periods and silence periods. The channel colour represents t-values, as shown in the colormap. The threshold for t-values is 12.44, corresponding to a large effect size (Cohen’s d>0.8). Only channels with a t-value above the threshold were color-coded to highlight the most robust task-specific ac8va8on. In P3, the greyed-out channels were lay on top of another grid. The grey line indicates the loca8on of the central sulcus. Label “A” represents the anterior direc8on and label “P” represents the posterior direc8on. Features extracted from the EMA tensor Figure 8 shows the Hme, arHculator-by-direcHon, parHcipant and word trial factors extracted from the EMA tensor . The Hme factor shows temporal profiles of kinemaHc pa\erns shared across all arHculators. The arHculator-by-direcHon factor illustrates the strength of movements per arHculator along different direcHons. Considering both factors together reveals how the kinemaHc pa\erns evolve across Hme for each arHculator. For example, features 2 and 3 capture the tongue movements along the anterior-posterior direcHon within the first 0.5 seconds amer the speech onset. Overall, most movements occurred within 0.5 sec amer speech onset, which is the mean duraHon of word producHon. In the parHcipant factor, the commonality values of features 1-6 were 7.92, 7.88, 7.39, 7.32, 6.37, and 4.72, respecHvely, indicaHng that over half of parHcipants contribute similarly to the selected features. This result means that the extracted features generalize well across parHcipants. The word trial factor reflects the spaHotemporal arHculatory features for each word trial. In the word trial factor, the PCC between repeHHon 1 and 2 were 0.97, 0.93, 0.83, 0.95, 0.62, and 0.49 . PCC values were significant (P<0.05) for the first four features. Features 5 and 6 show a lower PCC, as well as lower commonality. Taken together, features 5 and 6 may reflect trial-specific arHculatory kinemaHcs pa\erns. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Figure 8. Ar>culatory features extracted from EMA data using TCA. The par>cipant factor of the EMA tensor. Each bar represents the contribu8on of each par8cipant to the feature . The ar>culator-by-direc>on factor of the EMA tensor. Each bar shows movements recorded by a sensor along anterior -posterior (x) or up-down (y) direc8on. We grouped sensors into three groups by ar8culators (lip, jaw, and tongue) and colored them in blue, green and orange according to the group . The dark colors (dark blue, dark green and dark orange) represent movements along the anterior-posterior (x) direc8on, and the light colors (light blue, light green, and light orange) represent movements along the up-down (y) direc8on. The >me factor of EMA tensor. The black line indicates the speech onset, and the red line indicates the mean dura8on of spoken wo rds averaged across all trials and across all par8cipants. The word factor of the EMA tensor. We showed the Pearson’s correla8on (r) between factor loadings of repe88ons for all words, as well as the linear regression fiXed line between repe88ons (shown as the red line). .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Features extracted from HD-ECoG tensor As in the EMA tensor, each dimension in the HD -ECoG tensor corresponds to one factor. Supplementary Figure S1 show the Hme, channel factor and word factor for P1, P2, and P3. Features in the Hme factor show the Hme profiles of basis funcHons that reflect the HFB acHvity shared across all acHve channels. In all parHcipants, we idenHfied three types of brain responses by inspecHng the Hme profiles: early response, mid response and late response. For each parHcipant, the basis funcHon reaching its peak amplitude prior to speech onset is marked as the early response; the basis funcHon showing rising acHvity amer speech onset and reaching its peak amplitude before mean speech offse t is marked as the mid response; and the basis funcHon reaching its peak amplitude around or amer the mean speech offset is marked as the late response (Figure 9). Features in the channel factor illustrate how the basis funcHons in the Hme factor are weighted for each channel , suggesHng the anatomical localizaHon of basis funcHons. In P1 and P3, channels with large weights are most located posteriorly, while in P2, channels with large weights are most located anteriorly. When examining the anatomical localizaHon of different types of brain responses, we did not observe a clear disHncHon in P1 and P3. However, in P2, the early response is evenly located across all acHve channels, while the mid and late responses are more anteriorly located. Features in the word trial factor reflect the spaHotemporal neural features for each word trial, i.e., the combinaHon of anatomical distribuHon of neural acHvaHon and Hme profiles of brain response . The PCC corresponding to early responses appeared to be lower than those corresponding with mid and late responses. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Figure 9. Three types of brain responses during the task: early, mid response and late responses. All temporal profiles were min-max normalized to enable direct comparison across par8cipants. The early, mid, late response are shown by the blue, orange and green line, respec8vely. We iden8fied the complete set of 8me features for each response type . For the early and late response, only one 8me feature was iden8fied per par8cipant , whereas for the middle response, two 8me features were iden8fied in P2. The speech onset is shown by the black dashed line, and the mean speech offset by the red dashed line. Generalisable ar,culatory feature reconstruc,on We reconstructed arHculatory features from neural features by using the gradient boosHng regression model . Figure 10 demonstrates the reconstrucHon performance averaged across word repeHHons. Among three HD -ECoG parHcipants, P1 achieved the best reconstrucHon performance, with a mean PCC of 0.8 0 (p<0.05), while P2 and P3 achieved a mean PCC of 0.75 (p<0.05) and 0.76 (pculatory feature reconstruc>on from neural features . For each par8cipant, we calculated the real distribu8on of PCC (shown in blue). We also calculated the simulated distribu8on of PCC by shuffling word labels of all features 1000 8mes (shown in yellow). The red dashed line denotes the significance threshold (α = 0.05), and the blue dashed line denotes the mean PCC of the real distribu8on. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint

Discussion

In our study, by recording brain acHvity from the vSMC using HD-ECoG grids and leveraging a publicly available EMA dataset , we demonstrated a generali zable BCI framework that reconstructed arHculatory features from three parHcipants without relying on their arHculatory or acousHc data. For individuals with severe vocal tract paralysis, this generalizable BCI framework , which is independent of individual-specific arHculatory or acousHc data, could be a promising way to restore speech from brain acHvity. Because arHculator movements were not measured in the HD-ECoG parHcipants, we used a TCA model to extract arHculatory features from a public EMA dataset . We then selected features with high commonality values, indicaHng that these arHculatory features capture arHculatory movement pa\erns shared across speakers. Earlier studies also a\empted to align arHculatory features across speakers. For example, Bocquelet and colleagues used a linear model to map the arHculatory features of individual speakers to the feature space of a reference speaker (Bocquelet et al., 2016). However, their approach can be biased by the arHculatory characterisHcs of the chosen reference, such as vocal tract shape. In contrast, our approach employed commonality to ensure that the selected features showed generalizable arHculatory kinemaHcs across healthy speakers, which is parHcularly advantageous when both acousHc and arHculatory data cannot be obtained from target users . A previous study not having arHculatory movement data available reported good results using an acousHc-to-arHculatory inversion model relying on parHcipants’ own audio data to generate arHculatory data for speech BCI development (Anumanchipalli et al., 2019). However, their approach requires parHcipants to produce intelligible speech, which is not feasible for individuals with severe vocal tract paralysis. Having extracted a set of generalizable arHculatory features across speakers, we next examined the interpretability of the extracted neural features. In all three parHcipant we idenHfied three types of brain responses: early, mid and late. Compared with previous studies, the early and late responses we observed resemble the transient response, which shows increased acHvity around speech onset/offset, and the mid response resembles the sustained response , which shows increased acHvity during the u\erance (Conant et al., 2018; Salari et al., 2018). However, we did not observe a clear disHncHon in the anatomical organizaHon among these responses, while Salari and colleagues found that transient responses were more anteriorly located and the sustained responses were more posteriorly located in their parHcipants with HD grids (Salari et al., 2018). One possible explanaHon is the relaHvely small number of acHve channels in our analysis . Beyond the anatomical organizaHon of these brain responses, we also considered their possible funcHonal roles: early and late responses may reflect the arHculator movements at the speech onset/offset, such as mouth opening or closing . AlternaHvely, the early response may also reflect movement planning (Salari et al., 2018). For the mid response, it may represent a nonspecific signal for holding the vocal tract configuraHon (Conant et al., 2018). To further understand the neural representaHon during word producHon, more HD -ECoG data will be needed. To reconstruct arHculatory features from brain acHvity, we train ed a gradient boosHng regression model using word trial factors from both the EMA and HD -ECoG TCA model s. In all three parHcipants, the reconstructed and the original arHculatory features significantly correlated with each other . However, the correlaHon coefficients were only slightly above the significance threshold (α = 0.05) , indicaHng that the arHculatory features may be similar across words . One possibility is that the arHculatory features of different words cluster closely in the low-dimensional space . Further studies should include more repeHHons per word and train a word -level classifier to evaluate the discriminability of arHculatory features. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint To the best of our knowledge, this is the first study to extract generalizable arHculatory features from healthy individuals and reconstruct them from brain acHvity of different individuals. Previous work showed that speakers share a similar state -space of arHculatory features, but only used this to reconstruct voice, demonstraHng the cross-subject arHculatory-acousHc transfer (Anumanchipalli et al., 2019) . Our study extends their work by showing the cross-subject arHculatory-neural transfer, demonstraHng that the generalizable arHculatory features can be reconstructed from brain acHvity, even if the two modaliHes are from different individuals. This finding is also consistent with prior research, where authors report structural similarity between the arHculatory features from healthy parHcipants and neural features from an individual with paralysis (Wille\ et al., 2023). Such cross- subject arHculatory-neural transfer is beneficial for speech BCI design: even for individuals with severe vocal tract paralysis, it may sHll be possible to reconstruct arHculatory movements by developing models using arHculatory data from healthy individuals. Recent advances in speech BCIs have shown the possibility of reconstrucHng speech directly from brain signal without relying on intermediate arHculatory features (Wairagkar et al., 2024; Li\lejohn et al., 2025). However, previous research suggests that arHculatory features are more robustly encoded in the vSMC than acousHcs features, and therefore can be learned faster with limited neural data (CharHer et al. , 2018; Conant et al. , 2018; Anumanchipalli et al. , 2019) . Thus, incorporaHng intermediate arHculatory features may enhance the speech decoding performance (Anumanchipalli et al., 2019) . Apart from audio synthesis, the intermediate arHculatory features can also be used to restore speech-related orofacial movements (Metzger et al., 2023). . Taken together, our results indicate that our generalizable BCI framework could be a promising approach for restoring the communicaHon for individuals with severe vocal tract paralysis, for whom arHculatory or acousHc data are not available. However, our current use of EMA data, which only contains 7 sensors a\ached to the upper vocal tract , restricts the ability to capture complete vocal tract movements. Using more complete arHculatory features that span the enHre vocal tract space may enable speech synthesis with human-like fidelity (Wu et al., 2023). Another limitaHon of our study is the vocabulary size. Our restricted vocabulary of 97 Dutch words is likely not enough to capture the full range of arHculatory gestures in natural conversaHon. Expanding to larger vocabularies and to sentences will be important for assessing reconstrucHon performance in more realisHc contexts. Finally, the proposed pipeline has only been validated offline. In the future, adapHng this framework for online use could enable real-Hme arHculatory-based speech BCIs.

Conclusion

Overall, we demonstrated that our proposed framework could reconstruct generalizable arHculatory features from brain acHvity from a separate group of able-bodied speakers, even when these speakers’ arHculatory or audio data were not available . Using these generalizable arHculatory features has potenHal for developing speech BCIs that can restore full communicaHon for individuals with severe vocal tract paralysis, while reducing the need for a large amount of training data.

Acknowledgement

This work is supported by Dutch Brain Interface IniHaHve (DBI2), project number 024.005.022 of the research programmed GravitaHon, which is financed by the Dutch Ministry of EducaHon, Culture, and Science (OCW) via the Dutch Research Council (NWO). .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint

References

Anumanchipalli, G.K., Char-er, J. & Chang, E.F. (2019) Speech synthesis from neural decoding of spoken sentences. Nature, 568, 493-498. Bocquelet, F., Hueber, T., Girin, L., Savariaux, C. & Yvert, B. (2016) Real--me control of an ar-culatory -based speech synthesizer for brain computer interfaces. PLoS computa/onal biology, 12, e1005119. Boersma, P . (2001) Praat, a system for doing phone-cs by computer. Glot. Int., 5, 341-345. Browman, C.P . & Goldstein, L. (1992) Ar-culatory phonology: An overview. Phone/ca, 49, 155-180. Char-er, J., Anumanchipalli, G.K., Johnson, K. & Chang, E.F. (2018) Encoding of ar-culatory kinema-c trajectories in human speech sensorimotor cortex. Neuron, 98, 1042-1054. e1044. Conant, D.F., Bouchard, K.E., Leonard, M.K. & Chang, E.F. (2018) Human sensorimotor cortex control of directly measured vocal tract movements during vowel produc-on. Journal of Neuroscience, 38, 2955-2966. Duffy, J.R. (2012) Motor speech disorders: Substrates, differen/al diagnosis, and management. Elsevier Health Sciences. Friedman, J.H. (2001) Greedy func-on approxima-on: a gradient boos-ng machine. Annals of sta/s/cs, 1189-1232. Friedman, J.H. (2002) Stochas-c gradient boos-ng. Computa/onal sta/s/cs & data analysis, 38, 367-378. Has-e, T. (2009) The elements of sta-s-cal learning: data mining, inference, and predic-on. Springer. Heeringa, W.J. (2004) Measuring dialect pronuncia-on differences using Levenshtein distance. Hurley, N. & Rickard, S. (2009) Comparing measures of sparsity. IEEE Transac/ons on Informa/on Theory, 55, 4723-4741. Jayaram, V., Alamgir, M., Altun, Y ., Scholkopf, B. & Grosse-Wentrup, M. (2016) Transfer learning in brain-computer interfaces. IEEE Computa/onal Intelligence Magazine, 11, 20-31. Jiang, W., Pailla, T., Dichter, B., Chang, E.F. & Gilja, V. (Year) Decoding speech using the -ming of neural signal modula-on. 2016 38th Annual Interna-onal Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, City. p. 1532-1535. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Kolda, T.G. & Bader, B.W. (2009) Tensor decomposi-ons and applica-ons. SIAM review, 51, 455-500. Lidlejohn, K.T., Cho, C.J., Liu, J.R., Silva, A.B., Yu, B., Anderson, V.R., Kurtz-Miod, C.M., Brosler, S., Kashyap, A.P . & Hallinan, I.P . (2025) A streaming brain-to-voice neuroprosthesis to restore naturalis-c communica-on. Nature neuroscience, 1-11. Metzger, S.L., Lidlejohn, K.T., Silva, A.B., Moses, D.A., Seaton, M.P ., Wang, R., Dougherty, M.E., Liu, J.R., Wu, P . & Berger, M.A. (2023) A high-performance neuroprosthesis for speech decoding and avatar control. Nature, 620, 1037-1046. Mugler, E.M., Tate, M.C., Livescu, K., Templer, J.W., Goldrick, M.A. & Slutzky, M.W. (2018) Differen-al representa-on of ar-culatory gestures and phonemes in precentral and inferior frontal gyri. Journal of Neuroscience, 38, 9803-9813. Ramsey, N.F., Salari, E., Aarnoutse, E.J., Vansteensel, M.J., Bleichner, M.G. & Freudenburg, Z. (2018) Decoding spoken phonemes from sensorimotor cortex with high-density ECoG grids. Neuroimage, 180, 301-311. Salari, E., Freudenburg, Z., Vansteensel, M. & Ramsey, N. (2018) Spa-al-temporal dynamics of the sensorimotor cortex: sustained and transient ac-vity. IEEE Transac/ons on Neural Systems and Rehabilita/on Engineering, 26, 1084-1092. Silva, A.B., Lidlejohn, K.T., Liu, J.R., Moses, D.A. & Chang, E.F. (2024) The speech neuroprosthesis. Nature Reviews Neuroscience, 25, 473-492. Tomasi, G. & Bro, R. (2006) A comparison of algorithms for figng the PARAFAC model. Computa/onal Sta/s/cs & Data Analysis, 50, 1700-1734. Wairagkar, M., Card, N.S., Singer-Clark, T., Hou, X., Iacobacci, C., Hochberg, L.R., Brandman, D.M. & Stavisky, S.D. (2024) An instantaneous voice synthesis neuroprosthesis. bioRxiv. Walshe, M. & Miller, N. (2011) Living with acquired dysarthria: the speaker's perspec-ve. Disability and rehabilita/on, 33, 195-203. Weiss, K., Khoshgojaar, T.M. & Wang, D. (2016) A survey of transfer learning. Journal of Big data, 3, 1-40. Wieling, M., Tomaschek, F., Arnold, D., Tiede, M., Bröker, F., Thiele, S., Wood, S.N. & Baayen, R.H. (2016) Inves-ga-ng dialectal differences using ar-culography. Journal of Phone/cs, 59, 122-143. Willed, F.R., Kunz, E.M., Fan, C., Avansino, D.T., Wilson, G.H., Choi, E.Y ., Kamdar, F., Glasser, M.F., Hochberg, L.R. & Druckmann, S. (2023) A high-performance speech neuroprosthesis. Nature, 620, 1031-1036. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Williams, A.H., Kim, T.H., Wang, F., Vyas, S., Ryu, S.I., Shenoy, K.V., Schnitzer, M., Kolda, T.G. & Ganguli, S. (2018) Unsupervised discovery of demixed, low-dimensional neural dynamics across mul-ple -mescales through tensor component analysis. Neuron, 98, 1099-1115. e1098. Wu, P ., Li, T., Lu, Y ., Zhang, Y ., Lian, J., Black, A.W., Goldstein, L., Watanabe, S. & Anumanchipalli, G.K. (2023) Deep speech synthesis from MRI-based ar-culatory representa-ons. arXiv preprint arXiv:2307.02471. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Supplementary materials .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Figure S1 ECoG Components of P1, P2, and P3. From le[ to right in each panel, we showed the channel factor, the 8me factor, and the word factor for par8cipant P1, P2 and P3, respec8vely. In the channel factor, the grey lines indicate the loca8on of central sulcus. In the 8me factor, the black dash lines indicate the speech onset and the red dash lines indicate the speech offset averaged across word trials. For components with the flat line, no brain ac8vity was reflected during the corresponding period . In the word factor, the red line s are the linear regression fiXed line between feature loadings of repe88on 1 and 2. We also showed the Pearson’s correla8on (r) between feature loadings of repe88on 1 and 2 for each selected feature. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Figure S2 Distribu>on of word produc>on during HD-ECoG data collec>on. We accumulate all word produc8on dura8on, which is the interval between speech onset and offset across all word trials for three HD -ECoG par8cipants and calculate the distribu8on. Figure S3. Similarity scores between TCA runs with different number of components. For each TCA run (blue dot), a similarity score was calculated across all TCA runs and the run with the lowest reconstrucHon error .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint Table S1. Average variance per ar-culator-by-direc-on across par-cipants . For each arHculator, the variance of movements along each direcHon: anterior -posterior (X), up-down (Y), and lem-right (Z) was calculated and average across parHcipants. Ar-culator Direc-on Anterior-posterior (x) Up-down (Y) Lej-right (Z) UL 1.41 1.62 1.52 RL 4.27 1.20 4.09 LL 6.18 4.38 3.19 JAW 2.23 2.55 1.69 TD 16.57 8.77 3.96 TB 17.22 9.46 3.93 TT 18.81 9.52 5.24 Similarity score The similarity of two fi\ed TCA models were calculated based on the angles between latent factors (Tomasi & Bro, 2006; Williams et al., 2018). For two fi\ed four-factor TCA models with R components , {𝐴, 𝐵, 𝐶, 𝐷} and {𝐴1, 𝐵1 , 𝐶1, 𝐷1}, the similarity score is, 𝑚𝑎𝑥 𝑤 ∈ Ω 1 𝑅 G H(1 − I𝜆% − 𝜆2(%)K maxN𝜆%, 𝜆2(%)OP (𝑎5𝑎1 ∙ 𝑏5𝑏1 ∙ 𝑐5𝑐1 ∙ 𝑑5𝑑1)] & %'( , where Ω denotes all possible permutaHons of all factors , and 𝑤 is a parHcular permutaHon. When calculaHng the similarity score, every Hme one component is selected from each of the four factors, each scaled to unit length and 𝜆% denotes the product of these scalings. The similarity score is averaged across all components. Amer enumeraHng all possible permutaHons, the maximal similarity score is taken as the final similarity score between these two TCA models. .CC-BY 4.0 International licensemade available under a (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is The copyright holder for this preprintthis version posted October 8, 2025. ; https://doi.org/10.1101/2025.10.08.680888doi: bioRxiv preprint

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: oa-pdf

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2025) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00
unpaywall
last seen: 2026-05-21T05:10:58.409756+00:00
License: CC-BY-4.0