Abstract
The continuingly decreasing cost of next-generation sequencing has recently led to a significant increase in
the number of microbiome-related studies, providing invaluable information for understanding
host-microbiome interactions and their relation to diseases. A common approach in metagenomics consists
of determining the composition of samples in terms of the amount and types of microbial species that
populate them, with the goal to identify microbes whose profiles are able to differentiate samples under
different conditions with advanced feature selection techniques. Here we propose a novel backward
variable selection method based on the hyperdimensional computing paradigm, which takes inspiration
from how the human brain works in the classification of concepts by encoding features into vectors in a
high-dimensional space. We validated our method on public metagenomic samples collected from patients
affected by colorectal cancer in a case/control scenario, by performing a comparative analysis with other
state-of-the-art feature selection methods, obtaining promising results.
AUTHOR SUMMARY
Characterizing the microbial composition of metagenomic samples is crucial for identifying potential
biomarkers that can distinguish between healthy and diseased states. However, the high dimensionality
and complexity of metagenomic data present significant challenges in the context of accurately selecting
features. Our backward variable selection method, based on the hyperdimensional computing paradigm,
offers a promising approach to overcoming these challenges. By effectively reducing the feature space
while preserving essential information, this method enhances the ability to detect critical microbial
signatures associated with diseases like colorectal cancer, leading to more precise diagnostic tools.
Keywords
machine learning, hyperdimensional computing, vector-symbolic architecture, feature selection,
metagenomics, colorectal cancer
Introduction
Over the last decade, the cost of next-generation sequencing technologies has steadily decreased, a trend
that is expected to continue. This reduction has positively impacted all areas of the life sciences, resulting in
the generation of substantial biomedical data. Metagenomics, which involves the study of microorganisms
1
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
in biological samples and their relationship to pathological conditions and environmental factors, is one field
that has particularly benefited from these advancements. Metagenomics frameworks that rely on
sophisticated statistical analysis and machine learning techniques allow the identification of relevant
signatures across a wide range of pathologic conditions by inspecting differences in the abundance of
specific microbial species in large cohorts of samples in a case/control scenario. Many studies have
demonstrated the involvement of microbes in the genesis and development of a multitude of health-related
conditions, including cancer.
Here we focus in particular on the disease of colorectal cancer (CRC), which is the second most common
cause of cancer death worldwide (916,000 deaths) and the third for number of cases per year (1.93 million
cases in 2020) according to the World Health Organization [1]. Additionally, the American Cancer Society
(ACS) indicates that the 5-year survival rate (i.e., percentage of people affected by the same type and
stage of cancer still alive after 5 years from the first diagnosis) is approximately 65% when the cancer is
detected at an early stage [2]. Therefore, noninvasive methods allowing early detection of CRC are crucial
to enhancing patient survival. Numerous studies have recently examined the difference in the abundance of
specific microbes in metagenomics samples (usually fecal samples in the case of CRC) collected from case
and healthy individuals in order to establish whether it can be used as a fast, accurate, and noninvasive tool
for diagnosing the disease [3].
Here we propose a novel stepwise feature selection method following a backward variable elimination
strategy based on the brain-inspired hyperdimensional computing paradigm. Hyperdimensional (HD)
computing is a relatively new computational paradigm that aims to replicate the structure and function of the
brain in order to perform various computational tasks. It is based on the idea that the brain uses distributed
representations to encode and process information which is represented by unique vectors in a
high-dimensional space [4–6]. These vectors are often referred to as “semantic pointers” because they are
thought to encode the meaning of the information they represent [7].
This technology has been recently adopted to perform various computational tasks such as classification,
clustering, and pattern recognition in different scientific domains [8–12]. One of the key benefits of HD
computing is its efficiency because vectors used to represent information are distributed throughout the
high-dimensional space, making it possible to perform many operations in parallel, which makes it
well-suited for handling large amounts of data. It is brain-inspired in the sense that every concept is
encoded into vectors in a high-dimensional space that can be combined together with simple arithmetic
operations in order to represent more complex concepts, in the same way the human brain works with the
associative memory for distinguishing very similar concepts by remembering patterns [4,13,14]. We
integrated our method as a subroutine of chopin2 [15,16], an open-source Python 3.8 package originally
developed for classifying massive datasets with commodity hardware.
T o the best of our knowledge, this is the first attempt of building a feature selection method following this
emerging computing paradigm.
Results
We applied our feature selection algorithm on the relative abundance profiles of 241 microbial species
detected in 193 CRC and control samples obtained from the merging of three whole genome shotgun
sequencing datasets retrieved through the curatedMetagenomicsData package [17] for R:
2
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
ThomasAM_2018a, ThomasAM_2018b, and ThomasAM_2019_c (see the Methods section for additional
details). T aking in mind the well-known sexual dimorphism in individuals affected by CRC [18] and recent
studies that identified some gut-bacteria as possible age-specific biomarkers for the identification of CRC
[19–21], we stratified the samples according to biological sex (male and female) and age category (adult
and senior with age ≤65 and >65 respectively). For each of these datasets, we transformed the species
profiles into a binary matrix with 0 and 1 values only, where we consider the presence/absence of microbes
independently from their level of relative abundance (RA) (1 if the RA of a particular species in a specific
sample is >0, otherwise 0). Feature selection and HD classification model results on binarized and relative
abundance datasets are shown in T able 1A.
A Samples
(CRC)
Samples
(Control)
Data
type
Selected
features
Best
accuracy
Retrain
iterations Time Memory
(up to) Models B Selected
features
Sub-optimal
accuracy
(>70%)
Unstratified 101 92
RA 71 70.50% 0.2 14.61m 14.81GB 7,594 52 70.40%
binary 23 81.31% 0.2 4.03m 7.54GB 2,913 4 71.99%
w/ male only 67 53
RA 132 74.17% 0.8 22.68m 13.30GB 15,816 4 71.67%
binary 31 78.33% 0.0 5.20m 6.97GB 5,730 3 75.83%
w/ female only 34 39
RA 22 69.71% 0.2 11.60m 12.87GB 10,530 5 72.48%
binary 17 79.43% 1.2 4.68m 6.65GB 9,115 2 75.33%
w/ adult only 59 50
RA 44 73.51% 0.0 19.10m 13.20GB 14,288 8 70.69%
binary 54 84.33% 3.0 14.11m 8.44GB 15,465 2 75.19%
w/ senior only 42 42
RA 69 72.57% 12.6 18.70m 13.00GB 14,977 3 71.40%
binary 33 82.28% 0.8 5.43m 6.68GB 9,295 4 75.07%
Table 1: Panel A: Feature selection and classification results on (i) the whole dataset resulting from the merging of
the MetaPhlAn3 profile tables of ThomasAM_2018a, ThomasAM_2018b, and ThomasAM_2019_c (here called
Unstratified), and the same merged table stratified by biological sex and age category, by considering (ii) male
subjects (w/ male only), (ii) female subjects (w/ female only), adult subjects (age ≤65, here called w/ adult only), and
senior subjects (age >65, here called w/ senior only). Every dataset presents the same number of features (241
species) and it is processed twice with relative abundance (RA) and binary presence (binary) microbial profiles, by
reporting the number of selected features, the best accuracy, the number of retraining iterations (average on the
number of folds) for the classification model with the best accuracy, the computational time used to build and
evaluate all the HD classification models up to the end of the feature selection algorithm (in minutes – m), and the
amount of allocated memory, in addition to the total number of produced classification models; Panel B: Number of
features selected by chopin2 from sub-optimal HD classification models whose accuracy rate is lower than the best
one but always >70% with the minimum number of selected features.
It is worth noting that 10,000 was selected for HD vector dimensionality and 1,000 as the number of HD
levels for the datasets with RA profiles, while only 2 HD levels were specified for the binary representations
of microbial profiles. The maximum number of retraining iterations was set to 10, with retraining terminated
when the error rate for an iteration does not vary from the previous round. Here, the accuracy threshold has
been set to 60%, while the accuracy uncertainty percentage has been set to 1%. Finally, every
classification model was subjected to 5-fold cross validation. The computational time is reported in T able 1A
and refers to the total amount of time required for building and evaluating all the HD models generated
during the backward variable elimination process. Computation and evaluation of the HD models was
performed on a high-performance computing machine comprising 4 Intel Xeon Platinum 8276L CPUs (128
cores/224 threads) @ 2.20GHz and 6TB of RAM using 80 cores at most. Running time and memory
3
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
consumption profiles have been computed with memory-profiler v0.61.0 with an average of 13.43GB of
allocated RAM in case of RA models and 7.25GB in case of binary models.
In terms of accuracy, the HD models built on top of the binary datasets (data type binary) always reached
over 78% of accuracy, which is also always higher than the accuracy of the same models built over the
relative abundance profiles (data type RA; 74.17% accuracy in the best case, 69.71% accuracy in the worst
case).
In T able 1A, we also reported the number of selected features related to the best classification model
generated through the iterative steps of our algorithm (see the Availability section for the complete list of
selected microbial species). It is worth noting that, in order to reach these results, the software generated
and evaluated over 32 thousand classification models in total (see column Models in T able 1A).
Sub-optimal classification models significantly reduced the number of relevant features
with a minimal loss of accuracy
Here, we also considered sub-optimal results (classification models with lower accuracy rate, always
greater than 70%, with the minimum number of selected features) for the binary models, since we noticed
that the algorithm extracted a very small number of features able to distinguish the CRC class of samples
from the control class of samples with an accuracy slightly lower than the best one. Sub-optimal results are
summarized in T able 1B. Since the results about the RA datasets are always worse in terms of accuracy
and number of selected features, here we focused on the classification and feature selection results of
models built on the binarized datasets only.
The best sub-optimal HD model built on top of the binarized Unstratified dataset was able to discriminate
the CRC and Control samples with 71.99% of accuracy by considering only 4 features (species). Here we
report all of them with their prevalence percentage (P) in both CRC and control samples (P CRC and PControl
respectively): Eubacterium ventriosum (PCRC=54.46%; PControl=38.05%), Firmicutes bacterium CAG 145
(PCRC=53.47%; PControl=29.35%), Gemella morbillorum (PCRC=39.6%; PControl=3.26%), and Parvimonas micra
(PCRC=46.53%; PControl=9.78%).
Despite the feature selection algorithm extracting only 4 species from the Unstratified dataset while building
a high accuracy classification model, results on the same dataset stratified by biological sex and age
category are characterized by an even smaller set of features able to discriminate samples with roughly the
same level of accuracy (always >70%).
The algorithm selected 3 features only for the dataset with samples from male individuals with a
classification model that reached 75.83% accuracy: Anaerotruncus colihominis (PCRC=58.21%;
PControl=32.07%), Bifidobacterium pseudocatenulatum (PCRC=23.88%; PControl=60.38%), and Parvimonas
micra (PCRC=44.78%; PControl=7.55%). The number of species selected for the dataset with samples from
female individuals is 2, while the achieved accuracy is 75.33%: Blautia sp CAG 257 (PCRC=14.71%;
PControl=35.9%) and Gemella morbillorum (PCRC=50%; PControl=2.56%).
The two datasets stratified on the age category are also characterized by a similar situation. Our method
selected 2 species for the dataset with samples from adult individuals with a 75.19% accurate classification
model: Oscillibacter sp CAG 241 (PCRC=57.63%; PControl=38%) and Parvimonas micra (PCRC=59.32%;
4
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
PControl=6%). Similarly, the model built on the dataset with samples from senior individuals produced an
accuracy of 75.07% with 4 species: Actinomyces sp HMSC035G02 (PCRC=35.71%; PControl=26.19%),
Bifidobacterium pseudocatenulatum (PCRC=16.67%; PControl=47.62%), Streptococcus pasteurianus
(PCRC=11.9%; PControl=0%), and Streptococcus salivarius (PCRC=50%; PControl=88.1%).
Differential abundance analysis of species selected with sub-optimal models confirms
known microbial biomarkers
These results show a prevalence of the Firmicutes phyla among all the selected species (9 out of 11). Here
we computed the log2 fold change (log2FC) of all the species highlighted by our algorithm as the log2 of
the mean relative abundance of the case samples on the mean of the relative abundance of the control
samples (mean CRC/meanControl). Only 4 out of a total of 11 species have an absolute value of log2FC ≥ 1:
Gemella morbillorum (log2FC=3.6 in unstratified, log2FC=4.28 in female), Parvimonas micra (log2FC=2.25
in unstratified, log2FC=3.3 in adult), Bifidobacterium pseudocatenulatum (log2FC=-1.33 in male,
log2FC=-1.51 in senior), and Blautia sp CAG 257 (log2FC=-1.28 in female).
For these 4 species with absolute value of log2FC ≥ 1 selected from the dataset with unstratified samples,
only 2 species belonging to the Firmicutes phylum exhibited statistically significant differential relative
abundance according to the Wilcoxon rank-sum test (whose p-values have been corrected for multiple
hypothesis testing with the Benjamini-Hochberg procedure): Gemella morbillorum (p-value=1.32e-5;
FDR=1.59e-3), and Parvimonas micra (p-value=1.05e-5; FDR=1.59e-3). These statistically significant
species have been selected according to the thresholds of 0.05 on their p-values (p-value ≤ 0.05) and 0.2
on the FDR (FDR ≤ 0.2).
We repeated the same statistical analysis on the other four datasets whose samples have been stratified
according to biological sex and age, obtaining the same effect as correcting the Wilcoxon test for these
covariates. In the case of the dataset with samples from male individuals only, the 2 selected species that
have an absolute value of log2FC ≥ 1 also have statistical significance of differential relative abundance
according to the Wilcoxon test and the same threshold of 0.05 and 0.2 on the p-value and the FDR
respectively: Bifidobacterium pseudocatenulatum (p-value=6.15e-4; FDR=7.42e-2) and Parvimonas micra
(p-value=4.77e-4; FDR=7.42e-2). For the dataset with samples from female individuals, only one species
resulted in statistical significance among the two with an absolute value of log2FC ≥ 1: Gemella morbillorum
(p-value=5.05e-4; FDR=1.21e-1).
Following the same thresholds, the statistical test highlighted one significant species with log2FC ≥ 1 in the
case of the dataset with samples from adult individuals: Parvimonas micra (p-value=1.72e-6;
FDR=4.16e-4). Finally, there are no statistically significant species for the dataset with samples from senior
individuals according to the same threshold used for the other datasets.
According to the most recent updates of the Disbiome database [22], at the time of writing, 2 out of the 3
statistically significant and differentially abundant species identified here are linked to studies in which
CRC-affected individuals are involved. Their abundance has already been proposed as possible biomarker
for the detection of the disease and are well know to be involved in the destabilization of the colonic wall of
the gut, reported as possible cause of progression of CRC: Gemella morbillorum [23,24] and Parvimonas
micra [23,25,26].
5
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
Although the Bifidobacterium pseudocatenulatum does not show up in the Disbiome database as linked to
CRC, it has also been recently reported as a possible biomarker for the disease [27].
A comparison with classical wrapper-based feature selection methods
In order to validate our method, we performed a comparative analysis with different feature selection
strategies based on Random Forest, Decision Tree, Support Vector Machine (SVM), Logistic Regression,
and Extreme Gradient Boosting (XGBoost), on the same binarized datasets in 5-folds cross-validation.
T able 2 shows the results in terms of features which have been selected in at least 4 out of 5 folds and the
accuracy reached by the classical classification models. Features have been selected according to their
importance which produced the classification model with the best accuracy.
Random Forest Decision Tree SVM Logistic Regression XGBoost
F ACC t F ACC t F ACC t F ACC t F ACC t
Unstratified 2 80.30% 16m 1 72.56% 1s 6 77.70% 33s 11 81.86% 11s 18 79.79% 28m
w/ male only 13 83.33% 28m NA 65.83% 1s 5 81.66% 44s 2 80.00% 10s 5 76.66% 3m
w/ female only 1 78.09% 15m 1 76.57% 1s 3 76.57% 36s 2 78.00% 8s 1 80.85% 2m
w/ adult only 18 89.00% 16m 1 80.77% 1s 1 80.64% 20s 3 87.18% 9s 2 84.37% 3m
w/ senior only 2 77.50% 10m 1 72.57% 1s 4 75.00% 37s 4 73.82% 9s 2 70.07% 2m
Table 2: Feature selection based on the importance of the features assigned by specific machine learning models
(Random Forest, Decision Tree, Support Vector Machine - SVM, Logistic Regression, and Extreme Gradient
Boosting - XGBoost) built on the 5 unstratified and stratified datasets, reporting the number of selected features (F),
the accuracy (ACC), and running time (t) in seconds (s) and minutes (m). Models have been 5-fold cross-validated,
and the accuracy (ACC) is the mean value among the models with the highest accuracy in all 5 folds. We
considered a feature as selected if it turns out to be significant in at least 4 out of 5 folds (columns Features). The
accuracy levels are color coded according to the difference in accuracy with respect to the chopin2 results in T able
1 (light red if the accuracy is lower than the accuracy computed on the classification model built with chopin2, dark
red with NA value if no features were significant in at least 4 out of 5 folds, while no color has been applied in cases
where the classical approaches performed better than the level of accuracy computed on the chopin2 models).
Note that chopin2 performed better in terms of accuracy compared to most of the classification techniques
adopted in this comparative analysis (in average, +2.87% for the Unstratified dataset, +0.84% for the male
only dataset, +1.42% for the female only dataset, -0.06% for the adult only dataset, and +8.49% for the
senior only dataset). Also note that in the case of Support Vector Machine and Logistic Regression models,
we computed the absolute values on the feature coefficients in order to consider the importance of the
features both with negative and positive effects.
Note that 4 out of 4 species selected by chopin2 in the context of the sub-optimal model built on top of the
Unstratified dataset were found to be also relevant for at least one out of 5 feature selection techniques
applied on the same dataset (i.e., Eubacterium ventriosum , Firmicutes bacterium CAG 145, Gemella
morbillorum, and Parvimonas micra). For the stratified datasets, the number of features selected by
chopin2 that are also significant for at least one of the 5 classical feature selection techniques are: 2/3 (i.e.,
Bifidobacterium pseudocatenulatum and Parvimonas micra) and 1/2 (i.e., Gemella morbillorum ) for the
dataset with samples from male only and female only individuals respectively, and 1/2 (i.e., Parvimonas
6
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
micra) and 2/4 (i.e., Bifidobacterium pseudocatenulatum and Streptococcus salivarius) for the datasets with
samples stratified by age category (adult only and senior only respectively).
It is worth noting that, although the feature selection technique implemented in chopin2 relies on the
backward variable elimination strategy by iteratively removing features at each step as explained in the
Methods
section, and thus most of its running time is dedicated to the construction and evaluation of
multiple classification models, our approach produced more accurate results compared to the 5 classical
machine learning approaches adopted in this analysis. In particular, considering all 5 datasets, chopin2
generated over 105 thousand models in our experimentation in roughly 2 hours, which is the same time
required for running the whole comparative analysis.
The comparative analysis has been performed in Python 3.8 with the support of the scikit-learn library
v0.22.1 without tuning of methods’ parameters. A complete overview of the results, together with the code
to fully reproduce them, is available on Zenodo (see the Availability section). It is also worth noting that we
have not shown here a comparative analysis on the datasets with microbial relative abundance profiles. We
have not discussed these results since the classification models built on the binarized datasets always
performed better in terms of accuracy and extracted features. However, classification and feature selection
Results
for these models are also available on Zenodo.
Discussion
Here, we presented a novel feature selection algorithm based on the backward variable elimination
strategy. It has been developed on top of a supervised classifier built according to the hyperdimensional
computing paradigm, originally proposed for classifying massive datasets with commodity hardware. T o the
best of our knowledge, this is the first feature selection method working entirely with vector-symbolic
architectures. We want to stress the point that, despite the fact that we tested our method on biological
data, the software is domain-agnostic and can be easily applied on data from different knowledge domains.
Specifically, we tested our algorithm on abundance profiles of microbes in metagenomic samples of stool in
a case/control scenario related to CRC. We identified 11 species able to discriminate case and control
samples with high accuracy. Only 3 of them, i.e. Bifidobacterium pseudocatenulatum, Gemella morbillorum,
and Parvimonas micra, have been highlighted by the statistical analysis and are well-known in literature to
be linked in some way to the pathogenesis of the disease or as a possible cause of development of CRC.
However, 3 of the remaining 8 species, Eubacterium ventriosum , Streptococcus pasteurianus, and
Streptococcus salivarius, are also linked to CRC despite their abundance profiles not showing any
statistical significance between case and control samples [28–33]. Finally, there is no mention in the CRC
literature about the remaining 5 species (Firmicutes bacterium CAG 145, Anaerotruncus colihominis,
Blautia sp CAG 257, Oscillibacter sp CAG 241, and Actinomyces sp HMSC035G02), and they must be
further investigated to determine their role in relation to their abundance as possible rapid and non-invasive
diagnostic tool for colorectal cancer in sex- and age-specific individuals.
We are planning to apply the same technique to support large-scale metagenomic analyses in relation to
other pathologies, not necessarily limited to cancer diseases. We are confident this will highlight new
insights and will help define new highly-accurate non-invasive diagnostic tools for the detection of such
pathologies. Additionally, recent advancements in the development of novel techniques for identifying and
profiling unknown microbes [34] drastically increase the number of microbial species quantified in
metagenomic samples to tens of thousands. Classifying this kind of datasets can be challenging for the
7
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
state-of-the-art classification and feature selection methods, and the technique we proposed in this
manuscript can be a valid solution for efficiently dealing with such a massive number of features.
Furthermore, we are also working on improving the overall performance of chopin2 by running the process
of building hypervectors on GPUs and on distributed environments powered by Apache Spark in order to
unlock new potentialities of the software for scaling on hundreds of thousands of features.
Materials and methods
We focused our analysis on the relative abundance (RA) of microbial species profiled over 101 stool
samples of patients affected by CRC, in addition to 92 samples from stool of healthy individuals [35,36].
The authors of the selected studies aimed at identifying microbial signatures were able to discriminate the
CRC class of samples from the control ones with high accuracy in fecal samples from shotgun
metagenomics sequencing. Here we attempt to reproduce the same results with a novel HD-oriented
approach. It is worth noting that the 193 samples come from three different datasets (i.e.
ThomasAM_2018a, ThomasAM_2018b, and ThomasAM_2019_c) and their metadata, as well as their
microbial abundance profiles originally performed with MetaPhlAn3 [37], have been obtained through
curatedMetagenomicData [17] package for R.
T able 3 shows a summary of the 193 metagenomic samples involved in this analysis. It is worth noting that
113 out of 193 samples come from antibiotics-free individuals, while for the remaining samples this
information is lacking. Furthermore, these three datasets also contain 27 samples of patients affected by
Adenoma. However, the number of Adenoma patients is too unbalanced compared to the number of CRC
and control samples, thus we excluded them from our analysis.
Number of
samples
Sex
(F/M)
Age (years)
mean
(stdev)
range
(min–max)
N adult
(age ≤ 65)
N senior
(age > 65)
Colorectal Cancer (CRC) 101 34/67 62.41 (11.75) 28–84 59 42
Control 92 39/53 62.85 (10.53) 40–81 50 42
Table 3: Demographic summary of all metagenomic samples involved in this study and retrieved from public
datasets. They comprise 193 stool samples distributed over two classes (Colorectal Cancer, and Controls) from
female and male subjects ranging from 28 up to 84 years old grouped in two sub-classes (adult and senior)
according to the threshold of 65 years old.
We finally looked at the distribution of the samples over the age of the 193 individuals involved in the study
in order to check whether the number of samples in a class is too unbalanced compared to the number of
samples in the other class and vice versa also in relation to biological sex (male and female). The
distribution charts are shown in Figure 1, Panels A, B, and C. Considering the similar trend of the number of
samples from female and male individuals over the control and CRC classes, we opted to consider all the
193 samples for our study.
8
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
Figure 1: (Panels A, B, and C) Distribution of the 193 samples over the control and CRC classes in relation to the
age and biological sex of the involved individuals. Panel A shows the overall distribution of all samples, while Panel
B and C show the distribution of control and CRC samples respectively. It is worth noting that samples have been
grouped according to 5-years age intervals and the vertical dashed line at year 65 in all the three panels represent
the time point where an adult turns senior; (Panels D and E) Compact view of the microbial composition in the 193
CRC and Control samples. Panel D shows the total number of phyla, classes, orders, families, genera, and species
under the Bacteria kingdom, while the barplot in Panel E shows the number of species for each of the 8 phyla
detected in the dataset by MetaPhlAn3.
Preprocessing of microbial profiles
Since these samples come from different datasets, we first excluded those microbial species that have not
been detected in all the three studies by MetaPhlAn3. We can safely exclude these species by simply
adding their relative abundances to the unclassified profile, which contains the abundance of all the
unknown microbial species that MetaPhlAn3 was not able to detect in a particular sample, resulting in a
total of 337 species. We repeated the same process for very low abundant species with a relative
abundance lower than 1% (66 species), as well as species detected in less than 5% of the samples (30
species) in order to decrease the possibility of erroneous classifications. This reduced the total number of
profiled microbes to 241 bacterial species whose distribution is shown in Figure 1 (241 species, 103
genera, 42 families, 25 orders, 17 classes, and 8 phyla as reported in Panel D, with a majority of species
under the Firmicutes phylum (56.4%) as shown in Panel E). It is worth to note that MetaPhlAn3 reports a
relative abundance profile for each of the taxonomic levels, from the kingdom down to the species, for each
detected microbe. However, here we focused on the species level only.
Defining the Vector-Symbolic Architecture and Machine Learning Model
9
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
As widely described in previous studies [4,38–40], designing an analysis following the hyperdimensional
computing principles means that every atomic element in the input dataset must be first encoded into
high-dimensional vectors. Every operation is thus reduced to dealing with a very limited set of arithmetic
functions applied on the encoded vectors in the high-dimensional space. The set of vectors and functions is
called vector-symbolic architecture (VSA) [4].
We designed the procedure described in Algorithm 1 to build a classification model over a VSA defined on
an input numerical dataset:
Algorithm 1: Encoding data into high-dimensional vectors
Input: dataset D with S set of features,
number of hyperdimensional level vectors L,
vectors dimensionality d,
number of retraining iterations R
Output: the vector-symbolic representation of D
1: levels ← list of level vectors
2: base ← random bipolar vector of length d
3: for level = 1, 2, …, L
4: if level > 1
5: # Flip N numbers of random element in base
base ← flip(base, N)
6: append(levels, base)
7: # Split the dataset D into training and test sets
training, test ← split(D)
8: F ← number of features in S
9: R ← maximum number of retraining iterations
10: C ← list of classes in D
11: classes ← empty list with vector representations of classes in C
12: for class in C
13: # Initialize the class vector
vector ← [0…0]
14: for sample in training[class]
15: for n = 0, 1, …, F-1 in S
16: level ← get level vector from levels associated to the value under sample[n]
17: level ← rotate level by p positions
18: vector ← element-wise sum level and vector
19: append(classes, vector)
20: prev_errors ← 0
21: # Compute the model error rate
curr_errors ← evaluate(classes, training)
22: iterations ← count retraining iterations
23: while curr_errors != prev_errors and iterations < R
24: for sample, class in training
25: # Compute the cosine similarity between sample and the class vectors in classes
closest ← class of the closest vector in classes
26: if closest != class
10
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
27: # Element-wise subtract sample from the closest class vector in classes
# Element-wise sum sample to its class vector in classes
classes ← adjust(classes, sample)
28: prev_errors ← curr_errors
29: curr_errors ← evaluate(classes, training)
30: return classes
Algorithm 1: Pseudocode of the procedure designed to build a vector-symbolic architecture and machine learning
model implemented in chopin2. It is composed of three main steps: (i) the generation of hyperdimensional level
vectors, (ii) the definition of the vector representations of classes whose set represents the model, and (iii) the
retraining process (error mitigation) for optimizing the model’s prediction power.
First, it is important to have a look at the distribution of the numerical values in the input dataset. In the case
of microbial profiles here analyzed, we know that values range from 0 to 100 because they express relative
abundances. This information, as well as the precision of the numerical values, is extremely relevant
because every single value must be encoded into a random bipolar vector (containing 1 and -1 values only)
in the high-dimensional space (i.e. the length of vectors, usually 10,000). These vectors are usually built
starting from a single random vector and iteratively flipping values under a certain amount of random
positions (N elements are flipped where N is equal to the vector dimensionality d divided by 2 over the total
number of level vectors L). This guarantees that adjacent vectors are more similar compared to all the other
level vectors by also maintaining their quasi-orthogonality in the high-dimensional space. Vectors must be
approximately orthogonal so that they resolve at discernable distance from each other and thus could
represent different concepts (e.g., the number 0.002 is different from the number 0.0019, no matter how
close these numbers are, and thus they must be encoded into two approximately orthogonal vectors so that
they can be easily discriminated just by computing their distance in the high-dimensional space). These
vectors are called HD levels and represent the associative memory. The generation of HD levels is the first
step towards the encoding of a numerical dataset and it is described in Algorithm 1, lines 1–6. It is worth to
note that two different numbers can actually be mapped to the same level vector according to the total
number of levels and the global numerical interval in the dataset (e.g., if a dataset contains numbers
between 0.0 and 100.0, and the number of level vectors is 100, every number between 0.1 and 1.0 is
mapped to the same level vector).
As every classification method usually works, the set of samples in the dataset must be first decomposed
into training and test sets (Algorithm 1, line 7). The next step consists in building a vector representation of
each class by encoding and combining all the vector representations of the samples in the training set. In
order to do that, a sample is first encoded by binding (element-wise sum) all the vector representations of
the features under that specific sample. The position of the features is also relevant in defining the encoded
vector associated with the samples. In order to also track the feature information, the vector representation
of a specific numerical value is rotated (by permuting values) by n positions with n equal to the position of
the feature in the dataset (n = 0…F-1, with F equal to the number of features in the dataset; the vector
representation of the numerical value under the first feature is not permuted, while the vector associated
with the numerical value under the second feature is permuted of a single position, and so on up to the last
feature in the dataset). The vector representations of the samples belonging to a specific class are finally
bounded together for building the vector representation of that specific class. The set of vectors, one for
each class, together with the HD levels and this specific way of encoding data, represents the
11
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
vector-symbolic architecture, i.e., our classification model. The process of encoding data into vectors and
combining them to produce the vector representation of classes is described in Algorithm 1, lines 7–19.
The vector representation of a class is thus built by bounding together all the vector representations of
samples that belong to that specific class. This operation is extremely easy but summing up vectors also
leads to the introduction of noise that affects the prediction power of the whole classification model. We can
reduce the inevitable effects of introducing noise with an error mitigation technique known as retraining.
This process works by first predicting the class of the training samples that is established by computing the
inner-product (cosine similarity) between the vector representation of the training samples and each vector
representation of the classes. The closest class is the prediction. In the case of a misclassification, the
vector representation of the test sample is element-wise subtracted from the misclassified class vector in
order to reduce the noise that led to misclassifying the sample, while it is also element-wise added to the
correct class vector to amplify the informative signal of the test sample in the correct class. This process
can be performed iteratively many times, usually until the error-rate in a specific iteration converges, i.e., it
does not change anymore compared to the previous iteration (Algorithm 1, lines 20–29).
In order to test the model and evaluate its accuracy in correctly predicting the right class, the same process
of encoding samples is applied to the test set. The class associated with a sample in the test set is
predicted by computing the inner-product of its vector representation and each vector representation of the
classes built and adjusted during the previous step. Finally, the accuracy of the classification model is
computed as the number of correctly classified samples on the total number of samples in the test set.
Formalizing the feature selection problem
Here we formally define our feature selection method which belongs to the backward variable elimination
class of algorithms. It works by iteratively removing those features that do not have a significant
discriminative power for describing observations belonging to a specific class of samples. More specifically,
considering a dataset D with a set S of features, it starts by building a HD classification model considering
all the S features. The iterative part of the algorithm starts if the accuracy of the model is greater than a
specific threshold only.
During the first iteration, it generates all the possible combinations of features by creating S sets of S-1
features (by excluding a specific feature in all of the S sets of features). Then, it builds a HD classification
model for each of the S sets of features. It keeps track of the features excluded from the specific set of
features in case the classification models produced the best accuracy in this specific iteration. Subsequent
iterations work in the same way as the first one, except that the initial set of features is now permanently
lacking of the previously excluded irrelevant features. It finally stops processing the input dataset when the
best accuracy reached in a specific iteration is lower than a predefined threshold (e.g. it may not make
sense to keep removing features from a dataset whose classification model has an accuracy <50%) or
when there are no other features available in the set of features. Pseudocode for this approach is
summarized in Algorithm 2.
Algorithm 2: Stepwise Feature Selection as Backward Variable Elimination
Input: dataset D with S set of features,
number of hyperdimensional level vectors L,
12
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
vectors dimensionality d,
number of retraining iterations R
Output: reduced set S with selected features only
1: B ← empty bucket for taking track of irrelevant features
2: T ← accuracy threshold
3: # Build a HD model considering all the features in S according to Algorithm 1
# Define ACC as the accuracy of the HD model
ACC ← HD(D, S, L, d, R)
4: while ACC ≥ T and S is not empty:
5: M ← empty bucket for taking track of models accuracy and missing features
6: for each combination of S-1 features:
7: f ← missing feature
8: # Build a HD model considering all the S-f features according to Algorithm 1
# Define ACC as the accuracy of the HD model
ACC ← HD(D, S-f, L, d, R)
9: # Keep track of the missing feature and ACC
append(M, )
10: ACC ← best accuracy among those in M
11: f ← missing feature associated to the best ACC in M
12: # Add the missing feature f associated to the best ACC to the bucket B
append(B, )
13: # Remove the features in B from S
S ← S-B
14: return S
Algorithm 2: Pseudocode of the stepwise backward variable elimination algorithm implemented in chopin2. Given
a dataset D in input with S features, it iteratively builds a HD classification model by removing irrelevant features
that do not contribute to increasing the accuracy of the model itself. It iteratively generates all possible
combinations of S-1 features, and it definitively removes the irrelevant feature associated with the model with the
best accuracy. It keeps removing features until the best reached accuracy is greater than a specific threshold or
when it runs out of features.
T o further illustrate this approach, consider the visual representation of the feature selection algorithm in
Figure 2. It starts with an example dataset with five features and an empty bucket for taking track of the
irrelevant features. It first builds a HD classification model by considering all five features (S={F1, F2, F3,
F4, F5}) in the input dataset to make sure that there is enough informative content to distinguish the
different class of samples with a minimum level of accuracy, here fixed to 70% (step 1). The immediate next
step consists in generating all possible combinations of sets of S-1 features. Figure 2 (step 2) shows five
sets of four features each (i.e. (i) F2, F3, F4, and F5, (ii) F1, F3, F4, and F5, (iii) F1, F2, F4, and F5, (iv) F1,
F2, F3, and F5, and (v) F1, F2, F3, and F4). For each of them, the algorithm creates a HD classification
model that in this particular example produced a 93% as the best accuracy with the second set of features.
One of the classification models reached an accuracy of 68%, which is lower than the accuracy threshold of
70%, and thus it must be discarded. Here we also introduced the concept of “accuracy uncertainty
percentage”, which is a percentage that must be subtracted to the best accuracy in order to define a
threshold for establishing whether the accuracy reached by the other models is high enough to be
considered as a good result. In this case, the best accuracy is 93% and the “accuracy uncertainty
13
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
percentage” has been fixed to 5%. Thus, the threshold is defined as 88% (93% minus its 5%), and the best
Results
in this iteration are the second and third models with 93% and 91% of accuracy respectively. The
algorithm proceeds by applying the same strategy on the third iteration (step 3) by first reshaping the set S
of features removing F2 and F3 which are the features that have been excluded for the generation of the
best classification models during the previous iteration. Here, the best accuracy is 90% reached by the last
model. There are no other models that must be considered in this iteration since the accuracy reached by
the other models is lower than 85% (90% minus its 5%), and in any case lower than the accuracy threshold
of 70%. The last iteration (step 4) starts by again reshaping the set of features S removing F5 in addition to
F2 and F3. It generates two classification models with only one feature each. Their accuracy is high enough
to pass the accuracy threshold, but the best accuracy in this iteration is lower than the best accuracy
reached on the previous iteration (step 3). Thus, the algorithm concluded by selecting F1 and F4 as the
best features able to discriminate the samples in the input dataset with high accuracy, while F2, F3, and F4
do not significantly contribute to increasing the accuracy of the classification model.
Figure 2: Schematic representation of the backward variable selection algorithm on a dataset with 5 features
(F1-5). The first step simply runs the HD classification algorithm on the whole set of features and proceeds if the
accuracy of the model is greater than the predefined threshold of 70%. During the second step, five HD models are
generated, one for each combination of features by excluding one feature only (i.e., by moving the removed
features to the initially empty bucket). Models with accuracy <70% are automatically excluded (red areas), while the
excluded features (F2 and F3) of the models with 93% and 91% of accuracy (because 93% is the best reached
accuracy and 91% is high enough according to the uncertainty percentage of 5%) are considered to proceed with
the third iteration. The algorithm proceeds by generating three models with all the combinations of remaining
features minus one. The accuracy of two models does not satisfy the minimum accuracy threshold of 70%, while
one model reaches 90% of accuracy with three removed features (F2, F3, and F5). The last iteration produces two
classification models because only two features remained active at this point. Their accuracy is way lower than the
best accuracy reached by the model at the third iteration (90%). Thus, the algorithm ends by reporting F1 and F4 as
the minimum set of features for which the software is able to produce a classification model with high accuracy.
It is worth noting that the algorithm is extremely parallelizable at the single iteration level, since the
generation of the HD classification models are completely unrelated from each other. Also note that the
same strategy can be easily applied in a reverse order, following a forward variable selection approach, by
adding features one by one instead of removing variables. However, this mode is not currently implemented
in chopin2.
14
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
AVAILABILITY
MetaPhlAn3 profiles of the analyzed metagenomic samples and their metadata are publicly available
through the R package curatedMetagenomicData. The proposed algorithm is implemented as a subroutine
of the Python 3.8 software chopin2, whose source code is available on GitHub under the GPL-3.0 license at
https://github.com/cumbof/chopin2, it has been designed through the hdlib [41] Python library also available
on GitHub at https://github.com/cumbof/hdlib, and it is distributed through the Python Package Index (pip
install chopin2) and Conda (conda install -c conda-forge chopin2). It is also available on the Galaxy
platform [42,43] through the official T oolShed [44] at https://toolshed.g2.bx.psu.edu/view/iuc/chopin2 after
being revised and approved by the Intergalactic Utilities Commission (IUC). A tutorial for the Galaxy tool is
available on the Galaxy Training Network [45–47] at https://gxy.io/GTN:T00337. Classification models and
feature selection results presented with this manuscript are fully reproducible and available on Zenodo at
https://doi.org/10.5281/zenodo.11397775.
Acknowledgements
We wish to thank the Italian inter-university consortium CINECA for assigning us supercomputing resources
(project HDCOMP , grant number HP10CA0SGK to FC) that we extensively used to preliminarily test our
algorithm. We would also like to thank Dr. Jayadev Joshi and Dr. Bryan Raubenolt of the Center for
Computational Life Sciences, Lerner Research Institute of the Cleveland Clinic, for their constructive critical
feedback.
AUTHOR CONTRIBUTIONS
Conception and design of the study, FC; Software design and development, FC and ST ; Methodology and
analysis, FC, ST , and EW; Results interpretation, FC and DB; Research supervision, EW and DB;
Manuscript preparation FC; All authors provided critical revision of the manuscript and approved the final
version for submission.
CONFLICT OF INTEREST
DB has a significant financial interest in GalaxyWorks, a company that may have a commercial interest in
the results of this research and technology. This potential conflict of interest has been reviewed and is
managed by the Cleveland Clinic.
FUNDING
This work has been supported by the National Institutes of Health [U24HG006620, U24CA231877].
References
15
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
1. World Health Organization. Cancer. 2022. Available:
https://www.who.int/news-room/fact-sheets/detail/cancer
2. Survival Rates for Colorectal Cancer. 2022. Available:
https://www.cancer.org/cancer/colon-rectal-cancer/detection-diagnosis-staging/survival-rates.html
3. Li S, Liu J, Zheng X, Ren L, Yang Y , Li W, et al. Tumorigenic bacteria in colorectal cancer: mechanisms
and treatments. Cancer Biol Med. 2021. doi:10.20892/j.issn.2095-3941.2020.0651
4. Kanerva P . Hyperdimensional computing: An introduction to computing in distributed representation
with high-dimensional random vectors. Cognit Comput. 2009;1: 139–159.
doi:10.1007/s12559-009-9009-8
5. Karunaratne G, Le Gallo M, Cherubini G, Benini L, Rahimi A, Sebastian A. In-memory
hyperdimensional computing. Nature Electronics. 2020;3: 327–337. doi:10.1038/s41928-020-0410-3
6. Kanerva P . Hyperdimensional computing: An algebra for computing with vectors. Advances in
Semiconductor T echnologies. Wiley; 2022. pp. 25–42. doi:10.1002/9781119869610.ch2
7. Blouw P , Solodkin E, Thagard P , Eliasmith C. Concepts as Semantic Pointers: A Framework and
Computational Model. Cogn Sci. 2016;40: 1128–1162. doi:10.1111/cogs.12265
8. Imani M, Kong D, Rahimi A, Rosing T . VoiceHD: Hyperdimensional Computing for Efficient Speech
Recognition. 2017 IEEE International Conference on Rebooting Computing (ICRC). 2017. pp. 1–8.
doi:10.1109/ICRC.2017.8123650
9. Imani M, Bosch S, Datta S, Ramakrishna S, Salamat S, Rabaey JM, et al. QuantHD: A Quantization
Framework for Hyperdimensional Computing. IEEE Trans Comput Aided Des Integr Circuits Syst.
2020;39: 2268–2278. doi:10.1109/TCAD.2019.2954472
10. Neubert P , Schubert S, Protzel P . An Introduction to Hyperdimensional Computing for Robotics. KI -
Künstliche Intelligenz. 2019;33: 319–330. doi:10.1007/s13218-019-00623-z
11. Pale U, T eijeiro T , Atienza D. Multi-Centroid Hyperdimensional Computing Approach for Epileptic
Seizure Detection. Front Neurol. 2022;13: 816294. doi:10.3389/fneur.2022.816294
12. Menon A, Natarajan A, Agashe R, Sun D, Aristio M, Liew H, et al. Efficient emotion recognition using
hyperdimensional computing with combinatorial channel encoding and cellular automata. Brain Inform.
2022;9: 14. doi:10.1186/s40708-022-00162-8
13. Plate TA. Holographic reduced representations. IEEE Trans Neural Netw. 1995;6: 623–641.
doi:10.1109/72.377968
14. Levy SD, Gayler R. Vector Symbolic Architectures: A New Building Material for Artificial General
Intelligence. Proceedings of the 2008 conference on Artificial General Intelligence 2008: Proceedings
of the First AGI Conference. NLD: IOS Press; 2008. pp. 414–418. Available:
https://dl.acm.org/doi/abs/10.5555/1566174.1566215
15. Imani M, Huang C, Kong D, Rosing T . Hierarchical Hyperdimensional Computing for Energy Efficient
Classification. 2018 55th ACM/ESDA/IEEE Design Automation Conference (DAC). 2018. pp. 1–6.
16
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
doi:10.1109/DAC.2018.8465708
16. Cumbo F , Cappelli E, Weitschek E. A Brain-Inspired Hyperdimensional Computing Approach for
Classifying Massive DNA Methylation Data of Cancer. Algorithms. 2020;13: 233.
doi:10.3390/a13090233
17. Pasolli E, Schiffer L, Manghi P , Renson A, Obenchain V, Truong DT , et al. Accessible, curated
metagenomic data through ExperimentHub. Nat Methods. 2017;14: 1023–1024.
doi:10.1038/nmeth.4468
18. Abancens M, Bustos V, Harvey H, McBryan J, Harvey BJ. Sexual Dimorphism in Colon Cancer. Front
Oncol. 2020;10: 607909. doi:10.3389/fonc.2020.607909
19. Zhang Y-K, Zhang Q, Wang Y-L, Zhang W-Y , Hu H-Q, Wu H-Y , et al. A Comparison Study of Age and
Colorectal Cancer-Related Gut Bacteria. Front Cell Infect Microbiol. 2021;11: 606490.
doi:10.3389/fcimb.2021.606490
20. Mukherji R, Weinberg BA. The gut microbiome and potential implications for early-onset colorectal
cancer. Colorectal Cancer. 2020;9: CRC25. doi:10.2217/crc-2020-0007
21. Rebersek M. Gut microbiome and its role in colorectal cancer. BMC Cancer. 2021;21: 1325.
doi:10.1186/s12885-021-09054-2
22. Janssens Y , Nielandt J, Bronselaer A, Debunne N, Verbeke F , Wynendaele E, et al. Disbiome
database: linking the microbiome to disease. BMC Microbiol. 2018;18: 50.
doi:10.1186/s12866-018-1197-5
23. Yachida S, Mizutani S, Shiroma H, Shiba S, Nakajima T , Sakamoto T , et al. Metagenomic and
metabolomic analyses reveal distinct stage-specific phenotypes of the gut microbiota in colorectal
cancer. Nat Med. 2019;25: 968–976. doi:10.1038/s41591-019-0458-7
24. Yang J, Li D, Yang Z, Dai W, Feng X, Liu Y , et al. Establishing high-accuracy biomarkers for colorectal
cancer by comparing fecal microbiomes in patients with healthy families. Gut Microbes. 2020;11:
918–929. doi:10.1080/19490976.2020.1712986
25. Yu J, Feng Q, Wong SH, Zhang D, Liang QY , Qin Y , et al. Metagenomic analysis of faecal microbiome
as a tool towards targeted non-invasive biomarkers for colorectal cancer. Gut. 2017;66: 70–78.
doi:10.1136/gutjnl-2015-309800
26. Baxter NT , Ruffin MT 4th, Rogers MAM, Schloss PD. Microbiota-based model improves the sensitivity
of fecal immunochemical test for detecting colonic lesions. Genome Med. 2016;8: 37.
doi:10.1186/s13073-016-0290-3
27. Hasan R, Bose S, Roy R, Paul D, Rawat S, Nilwe P , et al. Tumor tissue-specific bacterial biomarker
panel for colorectal cancer: Bacteroides massiliensis, Alistipes species, Alistipes onderdonkii,
Bifidobacterium pseudocatenulatum, Corynebacterium appendicis. Arch Microbiol. 2022;204: 348.
doi:10.1007/s00203-022-02954-2
28. Wu Y , Jiao N, Zhu R, Zhang Y , Wu D, Wang A-J, et al. Identification of microbial markers across
populations in early detection of colorectal cancer. Nat Commun. 2021;12: 3063.
17
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Feature Selection with Vector-Symbolic Architectures
doi:10.1038/s41467-021-23265-y
29. Azimi M, Keshavarz Shahbaz S, Mansourabadi AH, Mohamed Khosroshahi L, Pourkalhor S,
Rezakhani M, et al. Intestinal Microbiota: Novel Personalized Cancer Immunotherapy in Colorectal
Cancer. Int Arch Allergy Immunol. 2022;183: 1147–1165. doi:10.1159/000525695
30. Gospodinova GR, Demirevska L, Daskalov I, Dimitrov GD. A Rare Case of Streptococcus pasteurianus
Endocarditis Signaling Colon Cancer. Cureus. 2023;15: e48328. doi:10.7759/cureus.48328
31. Sánchez JC, García-Garrote F , Coira A, López-Agreda H, Alonso-García MP . Colorectal neoplasia
associated with Streptococcus gallolyticus subspecies pasteurianus. Lancet Infect Dis. 2014;14:
272–273. doi:10.1016/S1473-3099(14)70031-3
32. Afek S, Sperber AD, Almog Y . Carcinoma of the colon presenting as Streptococcus salivarius sepsis. J
Clin Gastroenterol. 2004;38: 86–87. doi:10.1097/00004836-200401000-00021
33. Lawrence GW, McCarthy N, Walsh CJ, Kunyoshi TM, Lawton EM, O’Connor PM, et al. Effect of a
bacteriocin-producing on the pathogen in a model of the human distal colon. Gut Microbes. 2022;14:
2100203. doi:10.1080/19490976.2022.2100203
34. Blanco-Miguez A, Beghini F , Cumbo F , McIver LJ, Thompson KN, Zolfo M, et al. Extending and
improving metagenomic taxonomic profiling with uncharacterized species with MetaPhlAn 4. bioRxiv.
2022. p. 2022.08.22.504593. doi:10.1101/2022.08.22.504593
35. Thomas AM, Manghi P , Asnicar F , Pasolli E, Armanini F , Zolfo M, et al. Author Correction:
Metagenomic analysis of colorectal cancer datasets identifies cross-cohort microbial diagnostic
signatures and a link with choline degradation. Nat Med. 2019;25: 1948.
doi:10.1038/s41591-019-0663-4
36. Wirbel J, Pyl PT , Kartal E, Zych K, Kashani A, Milanese A, et al. Meta-analysis of fecal metagenomes
reveals global microbial signatures that are specific for colorectal cancer. Nat Med. 2019;25: 679–689.
doi:10.1038/s41591-019-0406-6
37. Beghini F , McIver LJ, Blanco-Míguez A, Dubois L, Asnicar F , Maharjan S, et al. Integrating taxonomic,
functional, and strain-level profiling of diverse microbial communities with bioBakery 3. Elife. 2021;10.
doi:10.7554/eLife.65088
38. Rahimi A, Kanerva P , Rabaey JM. A Robust and Energy-Efficient Classifier Using Brain-Inspired
Hyperdimensional Computing. Proceedings of the 2016 International Symposium on Low Power
Electronics and Design. New York, NY , USA: Association for Computing Machinery; 2016. pp. 64–69.
doi:10.1145/2934583.2934624
39. Ge L, Parhi KK. Classification Using Hyperdimensional Computing: A Review. IEEE Circuits and
Systems Magazine. Secondquarter 2020;20: 30–47. doi:10.1109/MCAS.2020.2988388
40. Schlegel K, Neubert P , Protzel P . A comparison of vector symbolic architectures. Artificial Intelligence
Review. 2021. doi:10.1007/s10462-021-10110-3
41. Cumbo F , Weitschek E, Blankenberg D. hdlib: A Python library for designing Vector-Symbolic
Architectures. J Open Source Softw. 2023;8: 5704. doi:10.21105/joss.05704
18
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Cumbo F . et al. 2024
42. Giardine B, Riemer C, Hardison RC, Burhans R, Elnitski L, Shah P , et al. Galaxy: a platform for
interactive large-scale genome analysis. Genome Res. 2005;15: 1451–1455. doi:10.1101/gr.4086505
43. Galaxy Community. The Galaxy platform for accessible, reproducible, and collaborative data analyses:
2024 update. Nucleic Acids Res. 2024;52: W83–W94. doi:10.1093/nar/gkae410
44. Blankenberg D, Von Kuster G, Bouvier E, Baker D, Afgan E, Stoler N, et al. Dissemination of scientific
software with Galaxy T oolShed. Genome Biol. 2014;15: 403. doi:10.1186/gb4161
45. Batut B, Hiltemann S, Bagnacani A, Baker D, Bhardwaj V, Blank C, et al. Community-Driven Data
Analysis Training for Biology. Cell Syst. 2018;6: 752–758.e1. doi:10.1016/j.cels.2018.05.012
46. Clements D, Hiltemann S, Batut B, Rasche H, Heydarian M, The Galaxy Training Network. Using the
Galaxy Training Network tutorial library for bioinformatics training programs. J Biomol T ech. 2020;31:
S2. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7424776/
47. Hiltemann S, Rasche H, Gladman S, Hotz H-R, Larivière D, Blankenberg D, et al. Galaxy Training: A
powerful framework for teaching! PLoS Comput Biol. 2023;19: e1010752.
doi:10.1371/journal.pcbi.1010752
19
.CC-BY 4.0 International licenseperpetuity. It is made available under a
preprint (which was not certified by peer review) is the author/funder, who has granted bioRxiv a license to display the preprint in
The copyright holder for thisthis version posted November 20, 2024. ; https://doi.org/10.1101/2024.11.18.624180doi: bioRxiv preprint
Text is read by the "Ask this paper" AI Q&A widget below.
Extraction quality varies by source — PMC NXML preserves structure
cleanly, OA-HTML may include some navigation residue, and OA-PDF can
have broken hyphenation. The publisher copy
(via DOI)
is the canonical version.