Abstract
Background:Medical literature continues to grow at an astonishing rate,
rendering the traditionally manual, resource-intensive PRISMA guidelines difficult
to uphold. This bottleneck risks methodological transparency and efficiency,
demanding computational solutions.
Objective:Building on prior work in information retrieval from unstructured
medical data, this study introduces a framework, Computational-Assisted
Systematic Review and Meta-analysis (CASMA), to enhance the efficiency,
transparency, and reproducibility of evidence synthesis. Endometriosis recurrence,
marked by inconsistent definitions, serves as the ideal clinical case to demonstrate
the framework’s application.
Methods:The CASMA framework integrates standard PRISMA guidelines with
fuzzy matching and regular expression (regex) search to facilitate deduplication
and pre-screening of relevant records prior to manual paper selection. A specific
subclass of gonadotropin-releasing hormone agonists (referred to as GnRH-a
interchangeably) was chosen to avoid confounding from a potential response to an
intrauterine device. A modified splitting method addressed unit-of-analysis errors
in multi-arm trials, alongside other sensitivity, subgroup analyses, bias assessment,
and GRADE.
Results:This semi-automated process of pre-screening sharply reduced the
labour-intensive workflow: From fetching 33,444 records, the computational
pre-screening identified 29 potentially eligible records (including systematic
reviews and RCTs) for manual assessment in only 11 days. Hand searches were
performed on six manually selected meta-analyses to identify seven eligible RCTs
for evidence synthesis (841 patients; 152 recurrences). The pooled random-effects
model yielded a statistically significant Risk Ratio (RR) of0.64(95%confidence
interval (CI)(0.48to0.86)) (or a36%reduction in recurrence), with non-significant
heterogeneity (I2 = 0.00%,τ2 = 0.00). The profiling likelihood method confirmed
τ2 = 0.00, but its95%CI(0.00to0.59)indicates some level of uncertainty.
Sensitivity and subgroup analyses supported the robustness and stability of
arXiv:2509.16599v3 [cs.CL] 27 Oct 2025
the findings.
Conclusion:The consistency of the results with the existing evidence reinforces
that this subclass of GnRH-a is a promising management strategy to reduce
endometriosis recurrence. The CASMA framework is a validated, efficient,
and reproducible approach to help deliver medicine backed by the current best
evidence. This study bridges the gap between medical research and computer
science, offering a generalisable solution for managing the rapidly growing medical
literature.
Keywords:Computer and Language; Information Retrieval; Endometriosis;
Disease Recurrence; Evidence synthesis; Randomised Controlled Trials as Topic;
GnRH-a.
Introduction
Endometriosis has been documented in the medical literature since the mid-19th
century, yet treating the disease remains a source of considerable clinical
uncertainty.1,2 Endometriosis is a common gynaecological condition affecting over
190 million women worldwide,3 and it contributes to the Global Burden of Disease.4
While recurrence was once considered a rare event, it is now recognised as a common
and complex challenge.5 The rates of recurrence vary across the world, partially due
to inconsistent definitions.5 Consequently, the observed recurrence rate is a function
of both biological persistence and methodological definition. Post-operative hormonal
suppression is a widely used strategy to manage endometriosis and reduce the risk of
recurrence.6,7 The existing evidence reports a wide range of effects for these agents,
from no effect to a significant protective effect,5–8which makes translating evidence
into clinical practice difficult. Searching for definitive, confirmatory evidence is
therefore a critical research priority.
The immense and continuously expanding volume of literature on
endometriosis presents a substantial challenge to evidence synthesis when
strictly compiling with manual, resource-intensive PRISMA guidelines. This is
exemplified by the exponential growth in endometriosis publications since the
1960s (see Figures S.1 and S.2). A Computational-Assisted Systematic Review and
Meta-analysis (CASMA) framework was therefore employed to scale up evidence
synthesis with enhanced transparency and reproducibility. Following the standard
PRISMA guidelines, regular expressions (regex) search and fuzzy matching were
introduced to pre-screen the records before a manual selection process, efficiently
excluding 812 records in a few days. This paper applies the CASMA framework to
synthesise evidence about a specific subclass of GnRH-a (or GnRH-a interchargeably)
2
where the drug delivery does not involve the use of an intrauterine device (IUD). This
arrangement avoids the confounding reaction to a foreign body, leading to clearer
and more precise results for easier interpretation. The aim was to synthesise robust
evidence on the efficacy of the GnRH-a subclass in reducing endometriosis recurrence
by deploying the CASMA framework to achieve validated, reproducible, transparent,
and efficient evidence synthesis that leverages expert knowledge effectively.
Methods
Protocol and Registration
Prospective registration of the review protocol was not feasible due to time
constraints. Instead, the protocol was retrospectively registered on the Open Science
Framework (OSF); DOI: https://doi.org/10.17605/OSF.IO/R2DFA, registered
5 September 2025.
Search Strategy
Following PRISMA guidelines,9 a systematic search was conducted in PubMed,
Scopus, Google Scholar, and CrossRef between 6 and 17 June 2025. A final
free-text search was performed on 14 July 2025 after the research direction was
refined. Search terms combined controlled vocabulary (e.g., MeSH) and free text
to capture the population (“endometriosis”), interventions (“GnRH”, “hormonal
therapy”), and study designs (“meta-analysis”, “controlled trial”, “clinical trial”),
with adaptations for each database. The search terms were derived from several much
cited reviews1,10,11 and a post by Mayo Clinic.12 The full search syntax is available
as Supplementary Material.
To enhance efficiency, accuracy, and reproducibility, semi-automated
text-matching techniques – including fuzzy matching and regular expressions (regex)
– were integrated into the PRISMA workflow. This computational approach, which
facilitates a rapid assessment of records prior to manual screening, is inspired by a
previously proposed method for analysing unstructured medical data.13 Specifically,
fuzzy matching was performed on the titles to deduplicate records (an example is
shown in Table S.2 in the Supplementary section). The nativeR14 functions were
implemented to identify MAs of RCTs and to exclude records concerning network
meta-analyses, Bayesian studies, or associated diseases such as adenomyosis. An
3
automated research tool15 was employed to ensure that conducting an update of
a meta-analysis was an appropriate research direction after the manual selection
process was exhausted.
Eligibility Criteria and Outcome Definition
The initial plan was to conduct a meta meta-analyses, which was subsequently refined
to a meta-analysis of randomised controlled trials (RCTs). Eligible studies were RCTs
evaluating post-operative hormonal treatment for managing endometriosis, with a
control arm receiving placebo, expectant management, or no treatment. Studies were
excluded if the comparator (in)directly affected sex hormone levels or the hormonal
therapy involved intrauterine devices (IUDs), as IUDs might introduce confounding
due to the foreign body response.
The primary outcome measure was the recurrence of endometriosis. Leading
medical associations agreed that recurrence could be diagnosed through four
established methods: symptom-based, image-based, laparoscopic, or histological
diagnosis.2 Endometriosis is a complex disease, often presenting with various
symptoms and frequently coexisting with adenomyosis, which is often mistakenly
diagnosed as endometriosis. 2,16 Studies defining recurrence solely based on the
resolution or re-emergence of individual symptoms alone were excluded to ensure
that synthesised evidence about recurrence fitted the standardised terminology.2
Inter-rater Reliability (IRR)
Reviewer agreement for selecting meta-analysis papers was analysed in two stages.
A three-point grading system was employed to record the selection decision and for
computing the IRRs after the entire review process. This approach helps to avoid
selection bias. Discrepancies in paper selection were resolved through discussion.
The statistical approach was based on non-parametric bootstrapping with 2000
replications.
For the title/abstract review, a concordance of 82.76% (24/29 papers) was
reached, yielding a weighted absolute Kappa (κ) of 0.68 (95% bootstrap bias-corrected
and accelerated (BCa) confidence interval (CI) (0.396 to 0.884)). The agreement
is substantial.17 For the full-text review, only slight agreement was achieved; the
concordance was 57.14% (8/14 papers), and theκwas 0.05 (95% bootstrap CI
(-0.286 to 0.588)). A negativeκindicates that the observed agreement was lower than
4
expected by chance.17 The true level of agreement could plausibly range from poor
to moderate.17,18 Table S.2 presents the grading at the meta-analysis selection stage,
and the bootstrap results of each replication are depicted in Figure S.3(a) and S.3(b).
Data Extraction
ST extracted data on study design, patient characteristics, interventions,
comparators, and recurrence outcomes, recording them in a structured spreadsheet
that followed the format of well-written publications. A subset of data was
independently extracted by another reviewer in the same approach. Discrepancies
in data extraction and risk of bias (RoB) assessment were resolved by ST after
cross-checking the data against published systematic reviews, including a Cochrane
Systematic Review.
Statistical Analysis
Analyses were conducted on a device with a base clock speed of 2.55 GHz, 8 GB
RAM, and 8 threads.R(version 4.2.2) was the main statistical implementation. 14
data.table19 andHmisc 20 were the packages used for data wrangling. Inter-rater
reliability was computed using thepsy 21 package with weighted absolute Kappa.
boot22 wasemployedforallbootstrappedstatistics. EffectestimatesforGnRH-awere
calculated with themetaforpackage, 23 and risk-of-bias assessments were depicted
usingrobvis. 24 Risk ratios (RRs) were pooled using a random-effects model to
account for between-trial variability. A splitting method was applied to adjust for
multi-arm RCTs and mitigate unit-of-analysis errors.25 The method was modified
by proportionally splitting the control group to match the size of the intervention
arm of interest relative to that of all intervention arms. Truncation was applied to
ensure integer counts. Cumulative recurrence curves were digitised when necessary to
approximate intention-to-treat (ITT) counts.26 When ITT statistics and a cumulative
recurrence curve were not available, loss to follow-up was assumed to be independent
from recurrence.
A non-parametric bootstrap was performed to ensure robustness. For the
approximations of the IRRs at the two stages, 2000 replications were applied, and
10000replicationswereappliedtoverifythestabilityofthepooledRRanditsCI.The
profile likelihood method was used to derive a robust 95% CI for the heterogeneity
5
parameter (τ2), with the estimation performed with 50 steps to ensure numerical
stability.27
Other sensitivity and subgroup analyses were performed to check the stability
and robustness of the primary model. The Cochrane RoB 2 tool was the basis for
assessing the 5 domains of RoB of the included randomised controlled trials (RCTs).28
Publication bias was assessed using a Doi plot and LFK index due to the small number
of included studies (n= 7).29 The certainty of evidence for the primary outcome was
judged using the GRADE framework. The Summary of Findings table was obtained
from GRADEpro.30
Results
Our initial search identified 33444 endometriosis documents from four journal
databases (278 were potentially meta-analyses of RCTs) (see Figure 1). Grey
literature records were extracted from Google Scholar and Crossref (the three
categories stated in lower panel of the Figure S.2). The workflow followed the
PRISMA procedure, but introduced a semi-automated pre-screening stage prior to
manual screening. With the application of fuzzy matching and regex search, 745
records were eliminated. Combined with the two free-text search records, only 29
records required manual screening. The workflow, including record fetching 33444,
took only 11 days to complete. This process ultimately yielded two eligible MAs
with incomparable comparators. The decision to perform an update of an older MA7
was supported by the finding of an automated research tool15 (see Figure S.4). The
computation-assisted systematic review and meta-analysis (CASMA) process was not
only efficient, but also reliable. Following data extraction and discussion, seven RCTs
were confirmed as eligible for the evidence synthesis.
A summary of the included studies is presented in Table 1. Four trials were
conducted in Italy, two in China, and one was in the US or Canada. In these
studies, 443 patients received GnRH-a, and 398 received no treatment, a placebo,
or expectant management. All but one trial31 evaluated the risk of recurrence using
GnRH-a depots. In one study, 32 the specific drug was not reported; since it was
administered subcutaneously, it was classified as a GnRH-a depot. Two trials assessed
endometriosis recurrence based on symptoms.31,33 Five trials followed patients for 2
years, while two had follow-up periods of 1.5 or 5 years. All participants were of
reproductive age, but the accrual periods varied. The quality of research in two trials
6
was undermined by not reporting the accrual period31 or enrolling only 100 patients
over 4 years.32
Figure 1 – PRISMA Flow Chart for Study Selection
PubMed
(n=66)
Google Scholar (GS)
(n=140)
Scopus
(n=68)
Crossref
(n=33 168)
Grey Literature with Full-text
(n=565)
Free-text Search
(n=2)
Duplicates Excluded
(fuzzy matching)
• GS (n=25)
• Crossref (n=42)
Regex Search
(n=772)
Titles and Abstracts Screened
(n=29)
Full-text Records Assessed
(n=14)
Meta-analyses Identified
(n=2)
Decision
Handsearch RCT records (n=12)
Free-text Search (n=1)
Studies included in
Evidence Synthesis
(n=7)
Records Excluded from
Manual Screening
(n=745)
• Network Meta-analysis
• Bayesian theorem
• Fertility only
• Adenomyosis, etc
Not Eligible for Review
(n=15)
• Not endometriosis
• Not hormonal therapy
• Not placebo/expectant
• Not outcome of interest, etc
Unmatched Intervention,
Comparator or Design
(n=12)
Not Eligible for Meta-analysis
• Clinical trial (n=1)
• RCT cohort (n=1)
• Not GnRH-a (n=1)
• A comparator affects sex
hormone levels (n=1)
• Measure recurrence by each
symptom (n=1)
• Severe attrition bias (n=1)
Meta-analyses
IdentificationScreeningEligibilityRCT Records
Identification
Eligibility &
Included
The primary random-effects (RE) model (Figure 2(a)) pooled data from
7 papers, including 841 patients and 152 inferred recurrences. The pooled risk ratio
(RR) was 0.64 (95% CI (0.48 to 0.86)). This was statistically significant as the 95%
CI excluded the null value (1). The risk reduction was 36% (= (1−0.64)×100)
for patients who received this subclass of GnRH-a agents. This analysis included the
24-month recurrence from a trial that also reported a 12-month recurrence.33 When
the analysis was performed with the 12-month outcome, the pooled effect reduced
to RR = 0.59 (95% CI (0.43 to 0.81)), indicating a slightly stronger protective effect
(see Figure 3). However, the differences between the two analyses were not practically
meaningful, as the 95% CIs overlapped substantially.
7
Table 1 – Characteristics of Included Studies
study country design accrual baseline age surgery recurrence
diagnosis
intervention medication
duration
control follow-up Recurrence
GnRH-a Control
Hornstein et al. (1997)31 Canada & US Multicentre
– 2 arms
unknown stages II-IV I: 30.4±6.0;
C: 31.1±6.2
laser or
electrosurgery
symptomatic
– composite
measure
Nafarelin
nasal 400µg
6 months Placebo 24 months 17/56 26/53
Vercellini et al. (1999)33 Italy Multicentre
– 2 arms
02/92-06/94 stages I-IV I: 30.1±5.4;
C: 30.0±5.3
laparoscopy symptomatic
– composite
measure
Goseline SC
3.6mg
6 months Expectant 24 months 23/133 32/134
Busacca et al. (2001)34 Italy Multicentre
- 2 arms
01/97-12/99 stages III-IV I: 20-37;
C: 21-38
laparoscopy gynaecological
exam and/or
pelvic
echography
Leuropelin
acetate SC
3.75mg
3 months Expectant 36 months 4/44 4/45
Loverro et al. (2008)35 Italy 2 arms 01/98-01/99 stages III-IV I: 28.7±4.4;
C: 28.5±4.5
laparoscopic laparoscopic Triptorelin
depot 3.75mg
3 months Placebo 60 months 4/30 2/30
Sesti et al. (2009)36 Italy 4 arms 01/04-08/06 stages III-IV I: 30.8±6.0;
C: 31.3±5.1
laparoscopic
(uni-) or
(bil-)ateral
cystectomy
Echography
and
Second-look
laparoscopy
Group 2:
Tryptorelin or
Leuropelin
3.75mg
6 months Placebo 18 months 6/65 3/21
Huang et al. (2018)32 China 2 arms 01/11-12/14 reclassify
ASRM stages
into two
I: 36.41±5.19;
C: 36.81±6.92
laparoscopy echography GnRH agonist
SC 3.75mg
6 months No treatment 12 months 6/50 15/50
Yang et al. (2019)37 China 2 arms 01/15-03/16 stages III-IV 24-35 laparoscopy clinical and
biochemical
assessment
Triptorelin
3.75mg IM
6 months Expectant 24 months 1/65 9/65
8
Both analyses (Figures 2(a) and 3) showed negligible heterogeneity, with
standard metrics indicatingI 2 = 0.00%and a point estimate ofτ 2 = 0.00.I 2
expresses the proportion of variability in a meta-analysis which is explained by
between-trial heterogeneity rather than by sampling error, andτ2 the between-trial
heterogeneity.9 The complete picture was that the 95% CI forτ2 varied widely
(0.00 to 3), revealing that the true level of heterogeneity could be highly uncertain.
The choice of the random-effects model was, therefore, appropriate to account for this
potential true heterogeneity, highlighting the limitations of relying on point estimates
alone when assessing heterogeneity.
Figure 2 – The Primary Model and Its Leave-One-Out Results
(a)
(b)
The As-Treated (AT) analysis yielded a pooled effect smaller than the ITT
analysis, and the 95% CI was just 0.01 narrower (cf.Figures 2(a) and 4). Although
the difference was only at the second decimal place, it suggests that the AT analysis
slightly overestimates the protective effect of this subclass of GnRH-a agents. At
9
individual study level, Nafarelin nasal 400µg for 6 months was shown to be protective
against recurrence after endometriosis surgery in the AT analysis.31
Figure 3 – Sensitivity Analysis of the 7 papers
Figure 4 – As-treated Analysis
The non-parametric bootstrap analysis failed to converge in only 22 of 10,000
replications. It provided a pooled effect estimate, with a 95% BCa CI of(−0.84to
0.24)onthelog-scale(or(0.43to0.79)ontheRRscale). Thecloseagreementbetween
the standard and bootstrap CIs indicates that the pooled effect is robust and not an
10
artifact of the model’s assumptions. The point estimate forτ2 was0.00, with a 95%
CI of(0.00to3). The non-parametric bootstrap forτ2 could not provide a reliable CI
due to the large number of zero-valued replicates. However, the likelihood function
ofτ2 reinforced that the between-study heterogeneity was low, with0.00as the peak
of the function (Figure 5). The profiling likelihood 95% CI forτ2 (0.00 to 0.59)
signified uncertainty in heterogeneity, although its upper limit was substantially lower
than the CI estimated by the standard meta-analysis. A leave-one-out sensitivity
analysis (Figure 2b) further confirmed that GnRH-a had a protective effect against
endometriosis recurrence after surgery; that is, the pooled effect remained statistically
significantandwasnotdisproportionatelyinfluencedbytheremovalofanysingletrial.
Figure 5 – Between-Study Heterogeneity
A sensitivity analysis was conducted on a 5-paper model that excluded two trials
with severe methodological flaws (see Figure 6(a)).32,36 This model obtained a pooled
RR of 0.69 (95% CI 0.50, 0.94), which was slightly larger and had a wider 95% CI
in comparison with the primary model. Although the point estimate ofτ2 remained
0.00, its 95% CI (0.00, 8.57) was much wider than that of the primary model, whose
upper limit was 3. As Figure 6(b) illustrates, a leave-one-out analysis showed that
excluding the trial by Hornsteinet al.31 from this 5-paper model rendered the pooled
effect non-significant (p= 0.168). The trial’s substantial difference from the pooled
effect, combined with the loss of statistical significance, qualifies it as an influential
study or a potential outlier.
Therisk-of-bias(RoB)summaryplotispresentedinFigure S.5(a). Themajority
of the trials were rated as having a high RoB in the domains of deviations from
intended interventions (D2) and outcome measurement (D4). This suggests potential
11
issues with intervention consistency and outcome assessment across trials. Conversely,
low RoB was most prevalent in the domain of missing data (D3) and that of the
selection of reported results (D5). No trial scored a high risk in the randomisation
process (D1). Individual study scores are shown in Figure S.5(b), where all trials
were assessed as having a high overall RoB. We assessed eight papers in total. One
trial was eligible, but its results were not reliable; therefore, only its RoB could be
assessed. Because of the high overall RoB and serious indirectness, the certainty of
evidence was downgraded twice in the GRADE assessment (see Table S.3).
Figure 6 – A 5-paper Model
(a)
(b)
Funnel plot was not performed for this study due to the limited number of
included studies (n<10in the sensitivity analysis).9 Instead, a Doi plot and the LFK
index were calculated to assess for asymmetry.29 The LFK index was−0.113, which
falls within the accepted interval of[−1,1], indicating a lack of statistical evidence
for asymmetry (or publication bias). The Doi plot for the seven papers is presented
in Figure S.6, which visually suggested that two trials, and to a lesser extent a third,
appeared as potential outliers.
12
Discussion
This systematic review and meta-analysis (SRMA) of seven RCTs identified a
promising direction to address the long-standing clinical and methodological
question concerning the impact of hormonal therapy on reducing post-operative
endometriosisrecurrence. Thisstudydemonstratesthata specificsubclassofGnRH-a
agents offers a statistically significant protective effect in reducing post-operative
recurrence, a finding that directly addresses prevailing clinical scepticism regarding
the use of hormonal therapy for managing endometriosis after surgery. Recognising
automated tools for SRMA are increasingly free accessible, this paper details a
Computational-Assisted Systematic Review and Meta-analysis (CASMA) framework,
making it one of the first papers to open the discussion on the use of computer
technologies to achieve validated, efficient, reproducible, and transparent evidence
synthesis without violating the PRISMA guidelines.
The findings from the seven trials (including 841 patients and 152 inferred
recurrences) were subjected to comprehensive validity checks. External validity was
established by cross-checking the extracted data against data reported in published
reviews – including a Cochrane Systematic Review, which is widely considered a gold
standard in evidence synthesis. While not a gold standard practice, this approach
offers a pragmatic and methodologically robust alternative under the circumstances.
The consistency of the results with those reviews implies the extraction was accurate.
For internal validity, the primary analysis yielded a pooled RR of 0.64 (a 36%
reduction in risk), with a 95% CI (0.48 to 0.86). The close agreement with the
bootstrap 95% CI (0.43 to 0.79) indicates the result is stable and robust. The
likelihood profiling method confirmedτ2 = 0.00to be a valid point estimate and
provided a much narrower 95% CI than the standard meta-analysis, clarifying the
between-study heterogeneity. Subgroup analyses were performed by replacing a
data point in the primary model with one where the follow-up period was shorter,
and also on the five papers that had no serious methodological limitations. The
leave-one-out analysis on this 5-paper model identified an influential paper, yet the
same analysis showed that the primary model remained stable. All analyses, including
the As-Treated analysis, consistently suggested that GnRH-a had a protective effect,
and the homogeneity assumption failed to be rejected. These diverse statistical
Methods
were applied to establish internal validity and the robustness of the findings,
not for the purposes of data dredging. Publication bias was assessed by the Doi plot
with the LFK index rather than a funnel plot to obtain a more reliable measure where
the sample size was small.
13
By focusing on a specific subclass of GnRH-a, the findings provide a focused
complement to existing reviews with a broader scope. For example, one review
reported that hormonal therapy reduced endometriosis recurrence at both 12 months
or less (RR=0.30, 95% CI (0.17 to 0.54)) and at 13-24 months (RR=0.40, 95%
CI (0.27 to 0.58)), but these findings were coupled with substantial heterogeneity
(I 2 = 58%and57%respectively). 8 Another review found a protective effect across
a broader range of hormonal therapies (RR=0.44, 95% CI (0.30 to 0.66)), though
with low reported heterogeneity (I2 = 3%). 6 A direct comparison of the extent of
this reduction is challenging, as the estimations are based on different methodologies
and the definition of recurrence varies widely across studies.5 A previous review had
a similar scope to this paper,7 but the methodology was prone to unit-of-analysis
errors and included studies that deviated from standardised definitions. By applying
control-group splitting and excluding trials with potential confounding factors, the
present analysis provides a more internally consistent assessment of this subclass of
GnRH-a.
This study updates the evidence on endometriosis recurrence through the
applications of recently standardised definitions2, current methodological standards
and well-established computational techniques. The CASMA framework adds a
process of pre-screening prior to manual paper selection. It only involves applying a
semi-automated text-matching approach – fuzzy matching and regex – to efficiently
exclude 812 irrelevant records. From fetching 33444 records to completing the
pre-screening, it took less than 11 days to obtain a manageable collection of 29
records. Inspired by a previously proposed semi-automated method for analysing
unstructured medical data,13 this approach balances expert-driven screening with
automated solutions and can be applied to larger or more complex datasets without
violating PRISMA standards. The efficiency of the CASMA pre-screening minimised
the subsequent manual workload. Crucially, this framework eases the decision-making
process by avoiding overloading experts with information, allowing them to efficiently
adapt and integrate their clinical and methodological expertise via iterative search
string refinement. This approach is preferred to applying fully automated but
standardised solutions, where researchers are only given the option of accepting or
rejecting the proposed evidence.
The certainty of evidence, as assessed with the GRADE framework, was
rated as “Low” (see Table S.3). This was primarily due to a very serious RoB
and serious indirectness. Bias arose most prominently from deviations from
intended interventions and outcome measure, while indirectness reflected variations in
14
recurrence definitions, limiting the generalisability of the findings. The small sample
size prevented both a formal subgroup analysis and a full Qualitative Comparative
Analysis (QCA). Although QCA was a compelling tool to explore necessary and
sufficient conditions for recurrence, the limited number of studies (N= 7) and high
data sparsity precluded a meaningful interpretation. This paper demonstrates a case
of applying CASMA to synthesise robust evidence from a large body of literature
with much ambiguity circulating, offering a promising framework to synthesise the
current and best evidence to facilitate Evidence-Based Medicine practice.
Competing Interests
The author declares no competing interests.
Funding Statement
This research received no specific grant from any funding agency in the public,
commercial, or not-for-profit sectors.
Acknowledgements
I am deeply indebted to Professor Bruno Falissard of Université Paris-Saclay for his
intellectual guidance on this project and throughout the master degree program. My
thanks also extend to the dedication of other professors and Mr. Fares Youbi for
his generous assistance. I would like to thank Miss Meriem Souici for her assistance
with paper selection and some data extraction. I sincerely thank Professor Richard
F. Heller of Universities of Manchester, UK, and Newcastle, Australia for recruiting
me as a volunteer tutor for his charity foundation; the experience inspired me to find
my knowledge and skills for health-related research.
The opinions expressed in this article are those of the author and do not
necessarily reflect the views or policies of the affiliated institutions. Authorship is
defined by the ICMJE criteria.
15
Ethical Approval
This systematic review and meta-analysis was completed as part of the requirements
for a Master of Public Health (MPH) degree in Methodology and Biostatistics for
Biomedical Research, with research directions approved by Professor Bruno Falissard
at the Faculty of Medicine, Université Paris-Saclay. Since this study did not involve
any human or animal subjects or identifiable data, it was exempt from further
institutional review.
Protocol Registration and Data/Code Availability
The protocol for this research is registered on OSF. The DOI is https://doi.org/10.
17605/OSF.IO/R2DFA. The timestamp is 5 September 2025.
All data used were extracted from published studies. The data needed to
reproduce the results are included in the main content. Other data and theRcodes
will be deposited in the public OSF repository when this manuscript is published in
a peer-reviewed journal.
References
1. Koninckx, P. R., Ussia, A., Adamyan, L., Tahlak, M., Keckstein, J., Martin,
D. C.et al.(2021) The epidemiology of endometriosis is poorly known as the
pathophysiology and diagnosis are unclear,Best Practice & Research Clinical
Obstetrics & Gynaecology, 71, 14–26.
2. Tomassetti, C., Johnson, N. P., Petrozza, J., Abrao, M. S., Einarsson, J. I.,
Horne, A. W., Lee, T. T., Missmer, S., Vermeulen, N., Zondervan, K. T.,
Grimbizis, G., De Wilde, R. L., International Working Group of AAGL, E., ESGE
and WES (2021) An international terminology for endometriosis, 2021,Human
Reproduction Open, 2021(4), hoab029.
3. Ellis, K., Munro, D. and Clarke, J. (2022) Endometriosis Is Undervalued: A Call
to Action,Frontiers in Global Women’s Health, 3, 902371.
4. Feng, J., Zhang, S., Chen, J., Zhu, J. and Yang, J. (2022) Global Burden of
Endometriosis in 204 Countries and Territories from 1990 to 2019,Clinical and
Experimental Obstetrics & Gynecology, 49(10), 235.
16
5. Ceccaroni, M., Bounous, V.E., Clarizia, R., Mautone, D.andMabrouk, M.(2019)
Recurrent endometriosis: a battle against an unknown enemy,The European
Journal of Contraception & Reproductive Health Care, 24(6), 464–474.
6. Zakhari, A., Edwards, D., Ryu, M., Matelski, J. J., Bougie, O. and
Murji, A. (2021) Endometriosis recurrence following post-operative hormonal
suppression: a systematic review and meta-analysis,Human Reproduction
Update, 27(1), 96–107.
7. Zheng, Q., Mao, H., Xu, Y., Zhao, J., Wei, X. and Liu, P. (2016) Can
postoperative GnRH agonist treatment prevent endometriosis recurrence? A
meta-analysis,Archives of gynecology and obstetrics, 294(1), 201–207.
8. Chen, I., Veth, V. B., Choudhry, A. J., Murji, A., Zakhari, A., Black,
A. Y., Agarpao, C. and Maas, J. W. (2020) Pre- and postsurgical medical
therapy for endometriosis surgery,Cochrane Database of Systematic Reviews,
2020(11), CD003678.
9. Higgins, J. P. T., Thomas, J., Chandler, J., Cumpston, M., Li, T., Page,
M. J. and Welch, V. A. eds (2019)Cochrane Handbook for Systematic Reviews
of Interventions, 2nd edn. Chichester, UK: Wiley. ISBN 9781119536628
doi:10.1002/9781119536604 https://doi.org/10.1002/9781119536604.
10. Kvaskoff, M., Mahamat-Saleh, Y., Farland, L. V., Shigesi, N., Terry, K. L.,
Harris, H. R., Roman, H., Becker, C. M., As-Sanie, S., Zondervan, K. T.et al.
(2021) Endometriosis and cancer: a systematic review and meta-analysis,Human
reproduction update, 27(2), 393–420.
11. Olive, D. L. and Pritts, E. A. (2001) Treatment of endometriosis,New England
Journal of Medicine, 345(4), 266–275.
12. Mayo Clinic (2025)Endometriosis - Diagnosis and Treatment. https://www.
mayoclinic.org/diseases-conditions/endometriosis/diagnosis-treatment/drc-
20354661 (last accessed 2025-06-21).
13. Tsang, S. (2020) An experiment exploring the theoretical and methodological
challenges in developing a semi-automated approach to analysis of small-N
qualitative data,arXiv preprint arXiv:200204513.
14. R Core Team (2022).R: A Language and Environment for Statistical Computing.
R Foundation for Statistical Computing. Vienna, Austria. https://www.R-
project.org/. (last accessed R version 4.2.2).
15. Research Rabbit Team (2021) Research Rabbit: AI Tool for Smarter, Faster
Literature Reviews,ResearchRabbit. https://www.researchrabbit.ai/.
17
16. Olive, D. L. and Schwartz, L. B. (1993) Endometriosis,The New England Journal
of Medicine, 328(24), 1759–1769.
17. Landis, J. R. and Koch, G. G. (1977) The Measurement of Observer Agreement
for Categorical Data,Biometrics, 33(1), 159–174.
18. Vierkant, R. A. (1997) A SAS®Macro for Calculating Bootstrapped Confidence
Intervals About a Kappa Coefficient. InProceedings of the 22nd Annual SAS
Users Group International Conference, SAS Institute. https://support.sas.com/
resources/papers/proceedings/proceedings/sugi22/STATS/PAPER295.PDF.
19. Barrett, T., Dowle, M., Srinivasan, A., Gorecki, J., Chirico, M., Hocking, T.,
Schwendinger, B. and Krylov, I. (2025)data.table: Extension of ‘data.frame‘.
(last accessed Https://r-datatable.com, https://Rdatatable.gitlab.io/data.table,
https://github.com/Rdatatable/data.table).
20. Harrell Jr, F. E. (2024)Hmisc: Harrell Miscellaneous. https://CRAN.R-project.
org/package=Hmisc (last accessed r package version 5.1-3).
21. Falissard, B. (2022)psy: Various Procedures Used in Psychometrics. https://
CRAN.R-project.org/package=psy (last accessed r package version 1.2).
22. Canty, A. and Ripley, B. (2024)boot: Bootstrap R (S-Plus) Functions. https:
//CRAN.R-project.org/package=boot (last accessed r package version 1.3-31).
23. Viechtbauer, W. (2010) Conducting Meta-Analyses in R with the metafor
Package,Journal of Statistical Software, 36(3), 1–48.
24. McGuinness, L. A. and Higgins, M. J. ()robvis: A Tool for Visualizing
Risk-of-Bias Assessmentshttps://www.riskofbias.info/welcome/robvis-
visualization-tool. (last accessed 2025-08-24).
25. Axon, E., Dwan, K. and Richardson, R. (2023) Multiarm studies and how to
handle them in a meta-analysis: a tutorial,Cochrane Evidence Synthesis and
Methods, 1(10), e12033.
26. Drevon, D., Fursa, S. R. and Malcolm, A. L. (2017) Intercoder reliability and
validity of WebPlotDigitizer in extracting graphed data,Behavior modification,
41(2), 323–339.
27. Hardy, R. J. and Thompson, S. G. (1996) A likelihood approach to meta-analysis
with random effects,Statistics in Medicine, 15(6), 619–629.
28. Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron,
I., Cates, C. J.,et al.(2019) RoB 2: a revised tool for assessing risk of bias in
randomised trials,BMJ, 366, l4898.
18
29. Furuya-Kanamori, L., Barendregt, J. J. and Doi, S. A. (2018) A new improved
graphical and quantitative method for detecting bias in meta-analysis,JBI
Evidence Implementation, 16(4), 195–203.
30. McMaster University and Evidence Prime (2025)GRADEpro Guideline
Development Tool, [Software]. https://gradepro.org/ (last accessed 2025-08-23).
31. Hornstein, M. D., Hemmings, R., Yuzpe, A. A. and Heinrichs, W. L. (1997) Use
of nafarelin versus placebo after reductive laparoscopic surgery for endometriosis,
Fertility and Sterility, 68(5), 860–864.
32. Huang, C., Wu, M., Liu, Z., Shi, H., Han, Y. and Song, X. (2018) Clinical efficacy
and safety of gonadotropin-releasing hormone agonist combined with laparoscopic
surgery in the treatment of endometriosis,Int J Clin Exp Med, 11(4), 4132–4137.
33. Vercellini, P., Crosignani, P. G., Fadini, R., Radici, E., Belloni, C. and Sismondi,
P. (1999) A gonadotrophin-releasing hormone agonist compared with expectant
management after conservative surgery for symptomatic endometriosis,BJOG
An International Journal of Obstetrics & Gynaecology, 106(7), 672–677.
34. Busacca, M., Somigliana, E., Bianchi, S., De Marinis, S., Calia, C., Candiani,
M. and Vignali, M. (2001) Post-operative GnRH analogue treatment after
conservative surgery for symptomatic endometriosis stage III–IV: a randomized
controlled trial,Human Reproduction, 16(11), 2399–2402.
35. Loverro, G., Carriero, C., Rossi, A. C., Putignano, G., Nicolardi, V. and Selvaggi,
L. (2008) A randomized study comparing triptorelin or expectant management
following conservative laparoscopic surgery for symptomatic stage III–IV
endometriosis,European journal of obstetrics & gynecology and reproductive
biology, 136(2), 194–198.
36. Sesti, F., Capozzolo, T., Pietropolli, A., Marziali, M., Bollea, M. R. and Piccione,
E. (2009) Recurrence rate of endometrioma after laparoscopic cystectomy:
a comparative randomized trial between post-operative hormonal suppression
treatment or dietary therapy vs. placebo,European journal of obstetrics &
gynecology and reproductive biology, 147(1), 72–77.
37. Yang, Y., Zhu, W., Chen, S., Zhang, G., Chen, M. and Zhuang, Y. (2019)
Laparoscopic surgery combined with GnRH agonist in endometriosis,J Coll
Physicians Surg Pak, 29(4), 313–316.
38. Hair, J. F., Hult, G. T. M., Ringle, C. M. and Sarstedt, M. (2022)Partial least
squares structural equation modeling. Thousand Oaks, CA: Sage.
19
Supplementary Material
A Research Domain Grows Exponentially
Figure S.1 – The Growth of the Publications in
Endometriosis
Figure S.2 – An Approximation of Endometriosis
Research in the Pipeline†
†Due to limited computational resources, the records
could only be deduplicated using the prefixes of the
DOIs. Thismethodisnotasaccurateas fuzzymatching.
20
Extracting Records and Selection Process
Search terms were mutually agreed upon by ST and MS. The primary literature
search (for meta-analyses of RCTs) was conducted from 6 June to 14 July 2025.
Records were collected from multiple sources: PubMed yielded 37602 documents
on 6 June 2025; Google Scholar (GS) retrieved 583000 documents on 10 June 2025;
Crossref retrieved 33169 documents on 17 June 2025; and Scopus retrieved 52561
documents on 17 June 2025.
Based on repeated attempts, it was determined by ST that the following syntax
was the most reliable for screening out relevant records from PubMed:
“((((endometriosis) AND ((((((((((((((Hormonal contraceptive) OR (Progestin
therapy)) OR (Gonadotropin-releasing hormone)) OR (Aromatase inhibitor)) OR
(add-back therapy)) OR (non-steroidal anti-inflammatory drug)) OR (steroid))
OR (androgen))) OR (hormone replacement)) OR (hormone therapy)) OR
(hormone-related therapy)) OR (hormone suppression)) OR (hormonal alteration)))
AND ((randomised controlled trial) OR (clinical trial))) AND (meta analysis))”
Subsequently, ST adapted this keyword set to search Google Scholar (GS). GS
retrieved over 4160 records with these keywords. Given that itsrobots.txtfile
restricts web scraping, a maximum of 100 records could be obtained. To heighten
the chance of retrieving relevant manuscripts within that limit, ST included outcome
Keywords
in the search. The record count dropped from 4160 to 1470. ST fetched
140 webpages and prioritised the extraction of the most relevant records. The applied
Keyword
set was as follows:
“((((endometriosis) AND ((((((((((((((Hormonal contraceptive) OR (Progestin
therapy)) OR (Gonadotropin-releasing hormone)) OR (Aromatase inhibitor)) OR
(add-back therapy)) OR (non-steroidal anti-inflammatory drug)) OR (steroid))
OR (androgen))) OR (hormone replacement)) OR (hormone therapy)) OR
(hormone-related therapy)) OR (hormone suppression)) OR (hormonal alteration)))
AND ((randomised controlled trial) OR (clinical trial))) AND (meta-analysis)) AND
((cancer) OR (recurrence) OR (adverse effect))”
Data from the 140 records were extracted using anRprogramme written by ST. A
dissimilarity matrix of all the titles was computed using fuzzy matching. Levenshtein
distance was the computational basis for this process. It yielded results similar to
those obtained by the nativeagrep() Rfunction. Any count smaller than 5, but
not on the diagonal of the matrix, was considered a potentially duplicated pair. The
21
threshold was set to 5 because, on average, an English word contains 5 letters. The
Results
suggested the elimination of 25 records. This approach was applied to check
for duplicates both within and across databases. A manual review of the records
suggested that the relevance of subsequent entries was low, indicating a low chance
of having missed crucial records.
Crossref only allowed case-insensitive searches with the exact word,
“endometriosis.” When more terms were added, many more titles were retrieved
than were relevant to the term “endometriosis.” The system did not allow fetching
the titles and abstracts of records with full-text. ST first fetched the title, creation
date, DOI, publisher, type, and indexed information for each of 33169 records. ST
then fetched titles and DOIs for the records with full text. Of the27 886records
with full-text,565fell into the categories of posted-content, proceedings, and reports
(referred to as grey literature).42duplicated records were eliminated. Regex
searches were performed on388abstracts and their respective titles. For titles
without abstracts, ST reviewed the abstracts of the records indexed by the chosen
syntaxes. A variation of this approach was applied to the records obtained from
other databases. Figure S.2 shows the research trend after records with unique DOI
prefixes. This only gave an approximate view about the trend, because a single
record could be registered on different platforms. A more accurate view could not
be obtained due to insufficient computational power to apply fuzzy matching to the
titles.
Only six meta-analyses that fitted the research topic were identified. Of these,
only three reviewed RCT primary papers where the interventions were Diegogest, a
GnRH-a, and a GnRH-a with Chinese medicine. The latter was not considered a
potential topic because Chinese medicine is a broad field, which effectively tested an
unknown agent. Due to a tight timeline, the decision was made to hand-search the
RCTs within meta-analyses from a related domain and perform a free-text search.
The eligibility was confirmed during data extraction rather than independent review.
22
Manual Process of Paper Selection
Table S.1 – The 29 Records Shortlisted Following the Computational-Assisted Process
database author title round 1 assess round 2 potential action note
MS ST MS ST
crossref Shen et al.
(2020)
Fertility outcomes of deep
infiltrating endometriosis with
fertility desire—a meta
analysis
0 -1 0 -1 -1 -1 Studied fertility desire only
– Outside research scope
excluded
crossref Qing et al.
(2004)
Systematic Review and
Meta-analysis on the Effect of
Adjuvant
Gonadotropin-releasing
Hormone Agonist (GnRH-a)
on Pregnancy Outcomes in
Women with Endometriosis
Following Conservative
Surgery.
-1 -1 -1 -1 -1 -1 Studied fertility desire only
– outside research scope
excluded at round 1
GS Yang (2024) Endometriosis and aspirin: a
systematic review
-1 -1 -1 -1 -1 -1 The study compared
non-human samples.
excluded at round 1
GS Mikuš et al.
(2022)
State of the art, new treatment
strategies, and emerging drugs
for non-hormonal treatment of
endometriosis: a systematic
review of randomized control
trials
-1 1 -1 -1 -1 -1 Three subgroups:
antiangiogenic agents,
immunomodulators, and
natural components. Pelvic
pain is not a chosen research
topic.
excluded at round 1
PubMed Johnstone
et al.
(2015)
Controversies in the
Management of
Endometrioma: To Cure
Sometimes, to Treat Often, to
Comfort Always?
-1 -1 -1 -1 -1 -1 Its abstract is unstructured.
The MeSH terms indicated
that it is a meta-analysis.
The abstract suggests that
recurrence was not an
outcome measure.
excluded at round 1
PubMed Chen et al.
(2020)
Effect of melatonin for the
management of endometriosis:
A protocol of systematic
review and meta-analysis.
0 0 0 -1 -1 -1 The study focuses on the
effect of melatonin; it is
unclear if both beneficial
and adverse effects were
examined.
excluded
PubMed Deng et al.
(2020)
Chinese herbal medicine for
previous cesarean scar defect:
A protocol for systematic
review and meta-analysis.
-1 -1 -1 -1 -1 -1 The study focuses on
Chinese herbal medicine for
previous Caesarean scar
defect, not endometriosis.
excluded at round 1
PubMed Zhang et al.
(2021)
The efficacy and safety of
Kuntai capsule combined with
leuprorelin acetate in the
treatment of endometriosis: A
protocol for systematic review
and meta-analysis.
1 1 1 -1 -1 -1 Multiple, heterogeneous
interventions. Translating
the evidence into clinical
practice would be difficult..
excluded
PubMed Gao et al.
(2022)
Salvia miltiorrhiza-Containing
Chinese Herbal Medicine
Combined With GnRH
Agonist for Postoperative
Treatment of Endometriosis:
A Systematic Review and
meta-Analysis.
1 1 1 -1 1 1 Chinese Herbal Medicine is
a broad area. It is akin to
studying the relationship
between an unspecified
agent of unspecified
quantity and endometriosis
recurrence.
excluded
PubMed Allahqoli et
al. (2024)
Neuropelveology for
Endometriosis Management:
A Systematic Review and
Multilevel Meta-Analysis.
-1 -1 -1 -1 -1 -1 The focus is on a surgical
Method
(Neuropelveology)
excluded at round 1
PubMed Piacenti et
al. (2025)
Dienogest vs. combined oral
contraceptive: A systematic
review and meta-analysis of
efficacy and side effects to
inform evidence-based
guidelines.
1 1 1 -1 -1 -1 The author analysed RCT
and observational studies
together.
excluded
Scopus Lata and
Sarwar
(2014)
Effectiveness of conservative
surgery and adjunctive
hormone suppression therapy
versus surgery alone in the
treatment of symptomatic
endometriosis: A systematic
review with meta-analysis
-1 1 -1 -1 -1 -1 The study compares
adjunctive hormone
suppression therapy to
surgery alone, measuring
pelvic pain and recurrence.
excluded at round 1
Continued on the next page
23
database author title round 1 assess round 2 potential action note
MS ST MS ST
Scopus Chen (2014) Effectiveness and safety of
postoperative GnRH-a versus
laparoscopy alone for
endometriosis: A
meta-analysis
0 0 0 -1 -1 -1 Full-text paper was
unavailable; excluded due to
an inability to contact the
authors.
excluded
Scopus Liu (2021) Dienogest as a Maintenance
Treatment for Endometriosis
Following Surgery: A
Systematic Review and
Meta-Analysis
1 1 1 -1 -1 -1 Comparators:
Levonorgestrel-releasing
intrauterine system
(LNG-IUS) and
gonadotropin-releasing
hormone analogs (GnRH-a),
or non-treatment (NT).
Recurrence is an outcome.
excluded
Scopus Whelan
(2022)
Risk Factors for Ovarian
Cancer: An Umbrella Review
of the Literature
-1 -1 -1 -1 -1 -1 It is a meta-analysis of
cohort studies, which is not
the study design of interest.
excluded at round 1
Scopus Ivanov
(2023)
The issues of endometriosis
hormonal treatment in
reproductive age women
-1 -1 -1 -1 -1 -1 The full text is written in
Russian
excluded at round 1
Scopus de Souza
Gaio et al.
(2025)
Clinical effectiveness of
progestogens compared to
combined oral contraceptive
pills in the treatment of
endometriosis: A systematic
review and meta-analysis
1 1 1 1 1 1 All studies are RCTs. The
study compares
Progestogens vs OC, and
measures pelvic pain,
dysmenorrhea, and
psychological symptoms.
independent topic
Scopus Li (2024) Efficacy and safety of
dienogest in the treatment of
endometriosis: a meta-analysis
-1 -1 -1 -1 -1 -1 The full text is written excluded at round 1
Scopus Thiel (2024) The Effect of Hormonal
Treatment on Ovarian
Endometriomas: A Systematic
Review and Meta-Analysis
-1 -1 -1 -1 -1 -1 Mixed study types excluded at round 1
Scopus Shi (2022) Effect and safety of
drospirenone and
ethinylestradiol tablets (II) for
dysmenorrhea: A systematic
review and meta-analysis
-1 -1 -1 -1 -1 -1 Dysmenorrhea is not
endometriosis
excluded at round 1
Scopus Peng (2021) Dydrogesterone in the
treatment of endometriosis:
evidence mapping and
meta-analysis
-1 -1 -1 -1 -1 -1 Mixed study types excluded at round 1
Scopus Chen (2020) Pre- and postsurgical medical
therapy for endometriosis
surgery
-1 -1 -1 -1 -1 -1 The study states hormonal
suppression is effective but
most studies are covered by
other review papers.
Hormonal suppression is a
broad topic. It does not suit
a project with a tight
timeline.
excluded at round 1
Scopus Zakhari
(2020)
Dienogest and the Risk of
Endometriosis Recurrence
Following Surgery: A
Systematic Review and
Meta-analysis
1 1 1 -1 -1 -1 The paper compares
dienogest to expectant
management, but analyses
observational studies.
excluded
Scopus Jeng (2014) A comparison of progestogens
or oral contraceptives and
gonadotropin-releasing
hormone agonists for the
treatment of endometriosis: A
systematic review
-1 -1 -1 -1 -1 -1 The author noted that
proceeding to a
meta-analysis was
impossible.
excluded at round 1
Scopus Wu et al.
(2014)
Clinical efficacy of add-back
therapy in treatment of
endometriosis: A
meta-analysis
-1 1 0 -1 1 1 The study compares
GnRH-a with add-back
therapy versus GnRH-a
alone and addresses side
effects such as osteoporosis
and menopausal syndrome.
may match Gao et
al.
Scopus Wu, Wu
and Liu
(2013)
Oral contraceptive pills for
endometriosis after
conservative surgery: A
systematic review and
meta-analysis
-1 1 0 -1 1 1 The study compares OC to
no OC and other drugs
including gestrinone,
mifepristone, or GnRH-a,
measuring recurrence and
remission.
studied recurrence,
but can’t match
Zheng et al. (2016)
Continued on the next page
24
database author title round 1 assess round 2 potential action note
MS ST MS ST
Scopus Wong and
Lim (2011)
Hormonal treatment for
endometriosis associated
pelvic pain
1 1 1 -1 1 1 It is a review of RCTs that
synthesizes evidence from
three trial groups. The trials
that compared combined
oral contraceptives with
progestogen might align
with another meta-analysis.
However, the outcome
measures were
dysmenorrhea, not
endometriosis recurrence.
excluded
Keyword
search
Zheng et al.
(2016)
Can postoperative GnRH
agonist treatment prevent
endometriosis recurrence? A
meta-analysis?
1 1 1 -1 1 1 It reviewed RCTs and
recurrence of managing
operated endometriosis
patient with GnRH agonist.
independent topic
Keyword
search
Zakhari et
al. (2021)
Endometriosis recurrence
following post-operative
hormonal suppression: a
systematic review and
meta-analysis
1 1 1 1 -1 -1 The paper compares
hormonal therapies with
expectant management, and
recurrence is an outcome. It
analyses both RCTs and
observational studies
together.
It is of reference
value (mixed study
types)
N.B. A three-point scoring system was applied for records during the screening process:−1for rejected, 0
for unclear, and 1 for included (full-text retrieval). In both screening stages, records with a score of 0 were
re-evaluated.
25
Inter-Rater Reliability Plots
Figure S.3 – Distribution of Bootstrapped Inter-Rater Reliability at Two Stages
(a)
(b)
The two density graphs show the distribution of the weighted absolute Kappa (κ)
obtained from2 000non-parametric bootstrap replications. For Title/Abstract
screening, the distribution exhibited slight left skew (−0.23) and was mesokurtic
(−0.373). The meanκwas0.68, and the medianκwas0.69. For Full-text screening,
the distribution was right skewed (0.46), mesokurtic (0.65), and visually exhibited
bimodality. The meanκwas0.04, and the medianκwas0.00. Both distributions
are characterized by having skewness in an excellent range ([−1,+1]) and kurtosis
in a generally acceptable range ([−2,+2]).38 The agreement for the Title/Abstract
review was substantial, but that for the Full-text review was poor.17
26
Deduplication through Fuzzy Matching
Table S.2 – An Example of Identifying String Dissimilarities
Post-operative GnRH analogue treatment
after conservative surgery for symptomatic
endometriosis stage III–IV: a randomized
controlled trial
Use of nafarelin versus placebo after
reductive laparoscopic surgery for
endometriosis.
Clinical efficacy and safety of
gonadotropin-releasing hormone agonist
combined with laparoscopic surgery in the
treatment of endometriosis
A randomized study comparing triptorelin
or expectant management following
conservative laparoscopic surgery for
symptomatic stage III–IV endometriosis
Recurrence rate of endometrioma after
laparoscopic cystectomy: a comparative
randomized trial between post-operative
hormonal suppression treatment or dietary
therapy vs. placebo
A gonadotrophin-releasing hormone
agonist compared with expectant
management after conservative surgery
for symptomatic endometriosis
A gonadotrophin-releasing hormone
agonist compared with expectant
management after conservative surgery
for symptomatic endometriosis
Laparoscopic surgery combined with
GnRH agonist in endometriosis
Post-operative GnRH analogue treatment
after conservative surgery for
symptomatic endometriosis stage III–IV:
a randomized controlled trial
0 98 114 105 134 99 99 107
Use of nafarelin versus placebo after
reductive laparoscopic surgery for
endometriosis.
98 0 84 93 136 86 86 58
Clinical efficacy and safety of
gonadotropin-releasing hormone agonist
combined with laparoscopic surgery in
the treatment of endometriosis
114 84 0 92 129 84 84 95
A randomized study comparing triptorelin
or expectant management following
conservative laparoscopic surgery for
symptomatic stage III–IV endometriosis
105 93 92 0 137 76 76 112
Recurrence rate of endometrioma after
laparoscopic cystectomy: a comparative
randomized trial between post-operative
hormonal suppression treatment or
dietary therapy vs. placebo
134 136 129 137 0 136 136 138
A gonadotrophin-releasing hormone
agonist compared with expectant
management after conservative surgery
for symptomatic endometriosis
99 86 84 76 136 0 0 90
A gonadotrophin-releasing hormone
agonist compared with expectant
management after conservative surgery
for symptomatic endometriosis
99 86 84 76 136 0 0 90
Laparoscopic surgery combined with
GnRH agonist in endometriosis
107 58 95 112 138 90 90 0
N.B. The 6th and 7th titles exemplify the results of applying fuzzy matching to identify duplicated
titles. Where the number of titles is enormously large, any score below 5 and located off the diagonal
of the matrix represents a pair of titles with close similarity and may be further inspected.
27
Network of Publications
Figure S.4 – The Findings of an AI Research Tool15
N.B. A targeted search was conducted on 14 July 2025 to verify that the meta-analysis
by Zhenget al.7 was the most recent meta-analysis of RCTs on our chosen topic. The
two other meta-analyses published around 2020 included one that synthesised both
RCTsandobservationalstudies 6 andanotherthatfocusedonsurgeries. Consequently,
the decision to perform a targeted search rather than running another full selection
process was appropriate and not driven solely by the project timeline.
28
Risk of Bias
Figure S.5 – Summary of Risk of Bias (RoB2)
(a)
(b)
Publication Bias
Figure S.6 – Less Restrictive Measures of Publication Bias
29
Non-parametric Bootstrap Analysis
The following code was applied to obtain the non-parametric bootstrap results to
verify the pooled risk ratio, between-study heterogeneity and the corresponding 95%
CIs.
1# Non - P a r a m e t r i c
boot . func<- function( dat , indices ) {
sel<-dat [ indices ,]
res<- try( s u p p r e s s W a r n i n g s ( rma ( yi ,vi,data= sel ) ) , silent = TRUE )
5if(inherits( res , " try - error " ) ) {
NA
}else{
c(coef( res ) , vcov ( res ) , res$tau2 , res$ se. tau2 ^2)
}
10}
set. seed (print( seed . nbr<- sample(2^16 ,1) ) ) # 14453
( res . boot<-boot :: boot ( dat , boot . func , parallel = " m ul ti c or e " ,R=10000) )
range( res . boot$ t[ ,3][! is.na( res . boot$ t[ ,3]) ])
attr( res . boot , " seed . nbr " )<-seed . nbr
15saveRDS ( res . boot , " MA - Result_bo ot st ra p_np . rds " )
30
GRADE Assessment
Table S.3 – Summary of Findings†‡
A subclass of GnRH compared to placebo/expectant for patients who were operated for endometriosis
Bibliography
Certainty assessment Summary of findings
Participants
(studies)
Follow-up
Risk of bias Inconsistency Indirectness Imprecision Publication
bias
Overall certainty
of evidence
Study event rates (%)
Relative
effect
(95%
CI)
Anticipated absolute effects
With
placebo/expectant
With a
subclass
of GnRH
Risk with
placebo/expectant
Risk
difference
with a
subclass
of GnRH
The risk of endometriosis recurrence in patients managed by a subclass of GnRH after surgery (follow-up: range 12 months to 60
months; assessed with: objective, subjective or mixed assessment)
841
(7 RCTs)
very
serious1,2,3,4,5,6,7,a,b
not serious serious not serious all plausible
residual
confounding
would
suggest
spurious
effect, while
no effect
was
observed
⨁ ⨁ ◯ ◯
Low1,2,3,4,5,6,7,a,b
91/398 (22.9%) 61/443
(13.8%)
RR 0.64
(0.48 to
0.86)
91/398 (22.9%) 82 fewer
per 1,000
(from 119
fewer to 32
fewer)
CI: confidence interval; RR: risk ratio
Explanations
a. The overall risk of bias of each paper is high.
b. One eligible paper was excluded from the main synthesis and only assessed for risk of bias due to substantial loss to follow-up after randomization.
References
1.Busacca et al. Post-operative GnRH analogue treatment after conservative surgery for symptomatic endometriosis stage III--IV: a randomized controlled trial .Human Reproduction; 2001.
2. Hornstein et al. Use of nafarelin versus placebo after reductive laparoscopic surgery for endometriosis.; 1997.
3.Huang et al. Clinical efficacy and safety of gonadotropin-releasing hormone agonist combined with laparoscopic surgery in the treatment of endometriosis.Int J Clin Exp Med; 2018.
4.Loverro et al. A randomized study comparing triptorelin or expectant management following conservative laparoscopic surgery for symptomatic stage III--IV endometriosis.European journal of obstetrics &
gynecology and reproductive biology ; 2008.
5.Sesti et al. Recurrence rate of endometrioma after laparoscopic cystectomy: a comparative randomized trial between post-operative hormonal suppression treatment or dietary therapy vs. placebo .European
journal of obstetrics & gynecology and reproductive biology; 2009.
6.Vercellini et al. A gonadotrophin-releasing hormone agonist compared with expectant management after conservative surgery for symptomatic endometriosis .BJOG: An International Journal of Obstetrics &
Gynaecology; 1999.
7.Yang et al. Laparoscopic surgery combined with GnRH agonist in endometriosis.J Coll Physicians Surg Pak; 2019.
†The table was obtained from GRADEpro;30
‡Endometriosis treatment outcome is affected by surgical skills.1 Since the studies were conducted at different times and in different countries, skills might vary, and spurious confounding
may exist;
a. Risk of bias: Downgraded for the prevalent high/unclear risk of bias in included studies;
b. Risk of bias: Downgraded because one eligible paper was excluded due to substantial loss to follow-up after randomization, but before the study started;
c. Risk difference: Estimated from the RR by the application automatically. It was estimated that 82 fewer per1 000patients who were managed by this subclass of GnRH-a after endometriosis
surgery would develop recurrence, compared with those who were not on any GnRH-a therapy. The estimated 95% CI ranged from 119 fewer to 32 fewer per1 000patients.
31
Text is read by the "Ask this paper" AI Q&A widget below.
Extraction quality varies by source — PMC NXML preserves structure
cleanly, OA-HTML may include some navigation residue, and OA-PDF can
have broken hyphenation. The publisher copy
(via DOI)
is the canonical version.