Results
In total, we screened 2996 records and assessed 310 full-text articles for eligibility. Of those, 102 articles (32.8%) were eligible for preliminary data extraction (eFigure 1 in the Supplement ). After the selection criteria for the overlapping meta-analyses were applied ( Table 2 ), 58 articles 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 73 , 74 , 75 , 76 , 77 , 78 , 79 , 80 , 81 were selected for evidence synthesis; of those, 13 articles 24 , 25 , 26 , 27 , 35 , 36 , 42 , 72 , 73 , 74 , 79 , 80 , 81 were meta-analyses of RCTs, and 45 articles 25 , 28 , 29 , 30 , 31 , 33 , 34 , 38 , 40 , 41 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 75 , 76 , 77 , 78 , 79 were meta-analyses of cohort studies. The list of articles excluded after the selection criteria for the overlapping meta-analyses were applied is provided in eTable 3 in the Supplement .
Abbreviations: AMSTAR-2, Assessment of Multiple Systematic Reviews, version 2; COC, combined oral contraception; CPA, cyproterone acetate; DMPA, depot medroxyprogesterone acetate; DRSP, drospirenone; DSG, desogestrel; EE, ethinyl estradiol; FBG, fasting blood glucose; HC, hormonal contraception; HDL-C, high-density lipoprotein cholesterol; HIV, human immunodeficiency virus; HOMA-IR, homeostatic model assessment for insulin resistance; HR, hazard ratio; LDL-C, low-density lipoprotein cholesterol; LNG-IUS, levonorgestrel-releasing intrauterine system; MD, mean difference; NR, not reported adjusted or unadjusted effect size; OR, odds ratio; PCOS, polycystic ovarian syndrome; RR, risk ratio.
Thirteen eligible meta-analyses 24 , 25 , 26 , 27 , 35 , 36 , 42 , 72 , 73 , 74 , 79 , 80 , 81 described 60 potential associations, including 60 individual study estimates of adverse health outcomes associated with hormonal contraceptive exposure. The median number of RCTs per meta-analysis was 2 (IQR, 2-3), with a median sample of 91 participants (IQR, 75-154 participants) and a follow-up duration ranging from 3 months to 10 years. Additional descriptive characteristics are provided in eTable 4 in the Supplement .
Evaluation of the methodological quality of 13 meta-analyses 24 , 25 , 26 , 27 , 35 , 36 , 42 , 72 , 73 , 74 , 79 , 80 , 81 using the AMSTAR-2 tool revealed that 8 meta-analyses 24 , 27 , 35 , 36 , 42 , 73 , 74 (61.5%) were of high quality, 3 meta-analyses 25 , 26 , 72 (23.1%) were of low quality, and 2 meta-analyses 80 , 81 (15.4%) were of critically low quality ( Table 2 ; eTable 5 in the Supplement ).
Fourteen 24 , 25 , 26 , 27 of the 60 associations 24 , 25 , 26 , 27 , 35 , 36 , 42 , 72 , 73 , 74 , 79 , 80 , 81 (23.3%) were nominally statistically significant ( P ≤ .05) based on random-effects models. A total of 21 associations 25 , 35 (35.0%) had high heterogeneity ( I 2 > 50%). Small-study effects were found for 3 associations 25 , 26 (5.0%). Summaries of all significant and nonsignificant associations are provided in Table 2 and eTable 5 in the Supplement , respectively
Among the 14 statistically significant associations, 24 , 25 , 26 , 27 7 associations 24 , 25 , 26 reported an increased risk of adverse health outcomes but no major adverse health outcomes (eg, cardiovascular or cancer-associated outcomes) ( Table 2 ). For treatment purposes, one of the associations 24 with moderate-quality evidence reported an increased risk of weight gain among women with regular heavy menstrual bleeding who were using a levonorgestrel-releasing intrauterine system (risk ratio [RR], 2.60; 95% CI, 1.16-5.84) compared with women who were not using this system. Another association 25 with moderate-quality evidence reported an increased fasting insulin level with combined oral contraceptive use (desogestrel and low-dose ethinyl estradiol, 30 µg) for the treatment of PCOS (mean difference, 2.32; 95% CI, 1.15-3.49). No sensitivity analyses were conducted for these 2 associations 24 , 25 because of the limited number of studies.
We identified 7 associations 25 , 27 between hormonal contraceptive use and reductions in the risk of adverse health outcomes ( Table 2 ). One association 27 between the use of a levonorgestrel-releasing intrauterine system and a 78% reduction in the risk of endometrial polyps among pre- and postmenopausal women receiving tamoxifen and endometrial surveillance was graded as having high-quality evidence (odds ratio [OR], 0.22; 95% CI, 0.13-0.38). A subgroup analysis of this association including only postmenopausal women retained the same evidence ranking (eTable 6 and eFigure 2 in the Supplement ). Another association 25 between combined oral contraceptive use (cyproterone acetate and ethinyl estradiol, 30 µg) and reductions in fasting blood glucose (FBG) levels among women with PCOS was graded as having moderate-quality evidence (mean difference, −2.05; 95% CI −2.82 to −1.28). This association was upgraded to high-quality evidence after a sensitivity analysis excluding studies with high risk of bias (eTable 6 and eFigure 3 in the Supplement ). Among women with PCOS using combined oral contraception, the findings suggested increased high-density lipoprotein levels (mean difference ranging from 6.50 [95% CI, 1.91-11.09] to 10.00 [95% CI, 8.41-11.59] 25 ). In addition, women with PCOS experienced increases in low-density lipoprotein levels (mean difference ranging from 11.53 [95% CI, 4.73-18.34] to 15.08 [95% CI, 12.74-17.43] 25 ) and total cholesterol levels (mean difference, 42.20; 95% CI, 17.01-67.38 25 ). Associations that were initially graded as having evidence of very low to high quality in the primary analysis are provided in eFigure 6 and eFigure 7 in the Supplement , and more details on sensitivity analyses are reported in eTable 6 in the Supplement .
Forty-five eligible meta-analyses 25 , 28 , 29 , 30 , 31 , 33 , 34 , 38 , 40 , 41 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 75 , 76 , 77 , 78 , 79 described 96 potential associations, including 171 individual study estimates of adverse health outcomes associated with hormonal contraceptive exposure. The median number of studies per meta-analysis was 3 (IQR, 2-5), and the follow-up duration ranged from 3 months to 42 years. The median sample based on 47 associations was 199 participants (IQR, 107-2470 participants). For 29 of 96 associations (30.2%), the number of participants was greater than 1000. Additional descriptive characteristics are provided in Table 3 and eTable 7 in the Supplement , and details of adjustments made for potential confounding variables in the included meta-analyses are available in eTable 7 in the Supplement .
Abbreviations: AMSTAR-2, Assessment of Multiple Systematic Reviews, version 2; BMI, body mass index (calculated as weight in kilograms divided by height in meters squared); COC, combined oral contraception; CPA, cyproterone acetate; DRSP, drospirenone; DSG, desogestrel; EE, ethinyl estradiol; GSD, gestodene; HC, hormonal contraception; HPV, human papilloma virus; MD, mean difference; NA, not applicable or not available; NR, not reported adjusted or unadjusted effect size; OC, oral contraception; OR, odds ratio; PCOS, polycystic ovarian syndrome; POC, progesterone-only contraception; RBC, red blood cell; RR, risk ratio; SAH, subarachnoid hemorrhage; SRR, summary risk ratio; UA, unadjusted effect size; VTE, venous thromboembolism.
Associations that were nominally significant (ie, P ≤ .05) were graded as having convincing (class 1), highly suggestive (class 2), suggestive (class 3), or weak (class 4) evidence based on the amount of evidence, statistical significance, heterogeneity, small-study effect, excess significance bias, prediction interval, and credibility ceiling test.
Not applicable because of nonsignificant effect estimate or unavailable data.
Not applicable because estimated number was larger than observed, and there was no evidence of excess significance based on assumption made for plausible effect size.
Analysis of the methodological quality of 45 meta-analyses 25 , 28 , 29 , 30 , 31 , 33 , 34 , 38 , 40 , 41 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 75 , 76 , 77 , 78 , 79 using the AMSTAR-2 tool revealed that 6 meta-analyses 41 , 57 , 62 , 66 , 68 , 77 (13.3%) were of high quality, 14 meta-analyses 40 , 44 , 46 , 49 , 50 , 52 , 53 , 54 , 63 , 65 , 70 , 75 , 76 , 78 (31.1%) were of moderate quality, 7 meta-analyses 25 , 48 , 59 , 60 , 61 , 72 , 79 (15.6%) were of low quality, and the remaining 18 meta-analyses 28 , 29 , 30 , 31 , 33 , 34 , 38 , 43 , 45 , 47 , 51 , 55 , 56 , 58 , 64 , 67 , 69 , 71 (40.0%) were of critically low quality ( Table 3 ; eTable 8 in the Supplement ).
Forty 25 , 28 , 31 , 33 , 38 , 40 , 43 , 44 , 45 , 46 , 47 , 49 , 50 , 52 , 54 , 59 , 61 , 62 , 64 , 65 , 66 , 69 , 70 , 71 , 76 , 78 of the 96 examined associations (41.7%) were nominally statistically significant ( P ≤ .05), and only 4 associations 44 , 46 , 65 , 78 (4.2%) reached high significance with a P value of 1.00 × 10 −6 or less ( Table 3 ). Thirty-eight associations 25 , 28 , 29 , 31 , 33 , 38 , 40 , 41 , 44 , 47 , 48 , 49 , 51 , 52 , 53 , 57 , 59 , 60 , 62 , 64 , 65 , 67 , 69 , 72 , 75 , 77 , 78 (39.6%) had high heterogeneity ( I 2 > 50%). The 95% prediction interval excluded the null value for only 5 associations 46 , 64 , 70 , 78 (5.2%). Small-study effects were found for 10 associations 33 , 44 , 49 , 69 (10.4%), and no excess significance bias was observed for any association. Among 40 statistically significant associations, 25 , 28 , 31 , 33 , 38 , 40 , 43 , 44 , 45 , 46 , 47 , 49 , 50 , 52 , 54 , 59 , 61 , 62 , 64 , 65 , 66 , 69 , 70 , 71 , 76 , 78 only 18 associations 25 , 31 , 38 , 44 , 46 , 47 , 49 , 59 , 62 , 64 , 65 , 69 , 70 , 78 (45.0%) passed the credibility ceiling test using a ceiling value of 10%. Summaries of all significant and nonsignificant associations are provided in Table 3 and eTable 8 in the Supplement , respectively.
Thirty associations 25 , 28 , 31 , 33 , 38 , 44 , 46 , 47 , 49 , 54 , 59 , 61 , 62 , 65 , 66 , 69 , 71 , 76 , 78 with an increased risk of adverse health outcomes, including cardiovascular risk, cancer risk, or other major adverse outcomes (such as Crohn disease, ulcerative colitis, and risk of suicide), were statistically significant ( Table 3 ). One of those associations 46 (past oral contraceptive use and increased risk of endometriosis among women undergoing surgery for endometriosis) was supported by class 1 evidence (RR, 1.60; 95% CI, 1.40-1.82). Two associations 44 , 65 revealing increased risk of venous thromboembolism (VTE) were graded as having class 2 evidence. One of those associations 65 was among women using oral contraception compared with women not using oral contraception (OR, 2.42; 95% CI, 1.76-3.32), whereas the other association 44 was among women using low-dose combined oral contraception (desogestrel and ethinyl estradiol, <50 µg) compared with women using a levonorgestrel-releasing intrauterine system (OR, 2.05; 95% CI, 1.59-2.64). Among women with PCOS receiving combined oral contraception, findings suggested increased triglyceride levels (mean difference ranging from 0.73 [95% CI, 0.05-1.41] to 39.82 [95% CI, 23.43-56.22] 25 ). In addition, women with PCOS experienced an increase in total cholesterol levels (mean difference, 13.70; 95% CI, 3.74-23.66 25 ).
The association between past oral contraceptive use and the risk of endometriosis 46 was downgraded from class 1 to class 4 after a subgroup analysis excluding the population with surgically diagnosed endometriosis (eFigure 4 in the Supplement ). Of 2 associations 44 , 65 initially graded as class 2, neither retained the same evidence ranking after sensitivity analyses (eTable 9 and eFigure 5 in the Supplement ). Additional results from the sensitivity and subgroup analyses are provided in eTable 9 in the Supplement .
We also identified 10 significant associations 25 , 40 , 41 , 45 , 46 , 50 , 64 , 70 between hormonal contraceptive use and reductions in the risk of adverse health outcomes. However, none of those associations had class 1 or class 2 evidence ( Table 3 ). Associations that were initially graded as having suggestive, highly suggestive, or convincing evidence in the primary analysis are provided in eFigure 8 in the Supplement .
Discussion
This umbrella review examined 60 associations reported in 13 meta-analyses of RCTs 24 , 25 , 26 , 27 , 35 , 36 , 42 , 72 , 73 , 74 , 79 , 80 , 81 and found that none of the 14 statistically significant associations 24 , 25 , 26 , 27 between hormonal contraceptive use and increases in the risk of adverse outcomes were supported by high-quality evidence in the primary or sensitivity analyses. The association between the use of a levonorgestrel-releasing intrauterine system and reductions in the risk of endometrial polyps among postmenopausal women receiving tamoxifen 27 was supported by high-quality evidence, and the association with reductions in FBG levels among women with PCOS 25 was also graded as having high-quality evidence after sensitivity analysis. Another association between the use of cyproterone acetate and ethinyl estradiol, 30 µg, and reductions in FBG levels among women with PCOS 14 was also graded as having high-quality evidence after sensitivity analysis.
We also assessed 96 associations from 45 meta-analyses of cohort studies. 25 , 28 , 29 , 30 , 31 , 33 , 34 , 38 , 40 , 41 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 75 , 76 , 77 , 78 , 79 We found that none of the 40 statistically significant associations 25 , 28 , 31 , 33 , 38 , 40 , 43 , 44 , 45 , 46 , 47 , 49 , 50 , 52 , 54 , 59 , 61 , 62 , 64 , 65 , 66 , 69 , 70 , 71 , 76 , 78 between hormonal contraceptive use and adverse health outcomes were supported by convincing evidence in the primary and subgroup analyses. The risk of VTE among those who used oral contraception compared with those who did not was initially supported by highly suggestive evidence, but the evidence was downgraded to weak in the sensitivity analysis. Overall, the findings of this umbrella review suggested that the associations between hormonal contraceptive use and cardiovascular risk, cancer risk, and other major adverse health outcomes were not supported by high-quality evidence.
All meta-analyses of cohort studies evaluating estrogen-containing hormonal contraceptive agents 44 , 49 , 65 , 66 , 69 found that these agents were associated with an approximate 1.5- to 2.5-fold increase in the risk of VTE. None of the meta-analyses had class 1 evidence, but 2 meta-analyses 44 , 65 did meet the criteria for class 2 evidence. The remaining meta-analyses 49 , 66 , 69 had class 3 or class 4 evidence; however, the associations between the use of combined oral contraceptive use and VTE risk reported in these meta-analyses were significant, suggesting that concern about VTE risk is warranted. Estrogen increases hepatic production of prothrombotic clotting factors and decreases production of factors that promote clot breakdown, resulting in an increased risk of thrombotic events. 82 The consequences of the generation of progestin and its ability to promulgate estrogen’s VTE risk have been extensively studied and remain controversial. As observed in 3 of the included meta-analyses, 44 , 49 , 69 the effect size of progestin type was modest and potentially confounded by inconsistent controlling for body mass index (calculated as weight in kilograms divided by height in meters squared) and age, 2 factors known to be associated with VTE risk. Overall, this small variance was unlikely to be clinically meaningful when selecting a type of combined oral contraception.
In our umbrella review, metabolic changes were only assessed among women with PCOS. 25 Therefore, it was difficult to extrapolate these associations to the general population because women with PCOS are typically obese and at risk of metabolic syndrome, insulin resistance, and hyperlipidemia. Estrogen modifies lipid metabolism in the liver and regulates serum lipoprotein levels, resulting in increased high-density lipoprotein and triglyceride levels and decreased low-density lipoprotein and total cholesterol levels. 83 Progestin type can also have consequences for the extent of lipid profile change induced by exogenous estrogen. 84 Notably, the types of triglyceride particles increased by ethinyl estradiol have not been associated with increases in the risk of atherosclerotic disease. 85 Among women with PCOS using combined oral contraception, the findings from our review of meta-analyses of RCTs suggested increases in high-density lipoprotein levels (mean difference ranging from 6.50 to10.00 25 ), and the findings from our review of meta-analyses of cohort studies suggested increases in triglyceride levels (mean difference ranging from 0.73 51 to 39.82 25 ). Contrary to previous evidence, 86 our review found an increase in low-density lipoprotein levels (mean difference ranging from 11.53 to 15.08 in a meta-analysis of RCTs 25 ) and total cholesterol levels (mean difference of 42.20 in a meta-analysis of RCTs 25 and 13.70 in a meta-analysis of cohort studies 25 ) among women with PCOS. This difference potentially represents the consequences of different progestin formulations, follow-up durations, and compounding of factors underlying the metabolic changes of PCOS. The quality of evidence was rated class 4 in the cohort studies 25 , 47 and ranged from low to very low in the RCTs 25 for associations between women using combined oral contraception and lipid changes, such as increased total cholesterol and triglyceride levels. In addition, the absolute increase in laboratory values was unlikely to be clinically meaningful.
One meta-analysis of RCTs 25 had moderate- to high-quality evidence for an association between hormonal contraceptive use and increases in fasting insulin levels as well as decreases in FBG levels among women with PCOS. Although these findings appear to be contradictory, the progestin formulations in the tablets were different; desogestrel was used in the RCT reporting increased fasting insulin levels, and cyproterone acetate was used in the RCT reporting decreased FBG levels. The consequences of combined oral contraception for insulin sensitivity were mainly associated with the progestin component; therefore, the antiandrogenic properties of cyproterone acetate may be associated with decreases in insulin resistance and reductions in circulating androgen levels among women with PCOS, thereby producing the FBG levels observed. 87 However, the clinical importance of the impact of different progestins was likely to be minimal, and the use of any combined oral contraceptive agent was unlikely to be associated with diabetes among women with PCOS. 88
In 2 meta-analyses of cohort studies, 54 , 78 we found evidence of an approximately 1.5-fold increase in the risk of breast cancer 54 and an approximately 1.5- to 2.5-fold increase in the risk of cervical cancer 78 with the use of combined oral contraception, although the evidence was of class 3 and class 4 quality. Notably, the breast cancer associations reported 54 were among women with BRCA1 (OMIM 113705 ) and BRCA2 (OMIM 600185 ) variants rather than women in the general population. Individuals with BRCA1 or BRCA2 variants have an increased baseline risk of breast cancer, and the additive impact of combined oral contraceptive risks would be magnified. 89 , 90 Current and recent use of estrogen-containing hormonal contraception is thought to increase breast cancer risk through a tumor promoter effect rather than an initiator effect on preexisting cancer cells. 91 , 92 In addition, any increased risk of breast cancer returns to baseline 10 years after cessation of combined oral contraception. 93
This umbrella review also found class 4 evidence to suggest an association between combined oral contraceptive use and an increased risk of cervical cancer in a meta-analysis by Asthana et al. 78 Few studies included in that meta-analysis controlled for human papilloma virus infection status, which is an important factor associated with cervical cancer risk. In the meta-analysis by Asthana et al, 78 the subgroup analysis of studies including participants with known human papilloma virus infection suggested a modest increase in risk associated with combined oral contraceptive use. However, women using combined oral contraception have been reported to have more sexual partners and higher rates of human papilloma virus infection and to receive a greater number of Papanicolaou tests. 94 A combination of these factors likely explains the increased risk of cervical cancer among women currently using combined oral contraception. Similar to breast cancer risk, the risk of cervical cancer appears to be time sensitive, with little to no increased risk when combined oral contraception has been used for less than 5 years or has not been used for more than 10 years. 95
Our umbrella review suggested several benefits associated with hormonal contraception, including reductions in endometrial polyps in the setting of tamoxifen use 27 and decreases in the incidence of ovarian and colorectal cancers. 41 , 45 , 52 , 64 The most significant association that was supported by high-quality evidence was found in a meta-analysis of RCTs 27 in which the use vs nonuse of a levonorgestrel-releasing intrauterine system was associated with a 78% reduction in the risk of endometrial polyps among those receiving tamoxifen. Tamoxifen, a nonsteroidal selective estrogen receptor modulator, is known to induce the formation of endometrial polyps through its estrogen agonist effects on the endometrial lining. 96 The use of a levonorgestrel-releasing intrauterine system mitigates this risk through its suppressive action on endometrial proliferation. 27 , 97 Of note, controversy exists regarding the use of a levonorgestrel-releasing intrauterine system among patients with progesterone receptor–positive breast cancer because of the potential risk of disease recurrence. 98 Additional noncontraceptive benefits associated with combined oral contraception include reductions in the risk of ovarian 52 and colorectal cancers, 41 , 45 , 64 and the results of our review supported these findings. Although these associations 27 , 49 , 56 , 67 were graded as class 4 in quality, they have also been observed in multiple epidemiological studies. 99 , 100 , 101
Robust grading of previous meta-analyses offers clinicians a tool to better evaluate hormonal contraceptive recommendations for at-risk patients. This grading may assist health care practitioners in the selection of hormonal contraceptive agents for their patients and encourage the consideration of existing individual risk factors, such as VTE, cancer, and cardiovascular risk. The medical eligibility criteria guidelines published by the World Health Organization 102 and the Centers for Disease Control and Prevention 103 , 104 can be used to select appropriate hormonal contraception for specific groups of patients based on these risk factors. Future research would ideally include well-designed RCTs comparing adverse health outcomes among those using vs not using hormonal contraception. However, the feasibility of conducting RCTs large enough to detect many of these adverse outcomes is limited. Rigorous cohort studies may aid in better delineating these risks. 13 , 84 , 85 , 87
This study has several limitations. The umbrella review focused on existing meta-analyses. We found that some adverse outcomes were not included in these meta-analyses, precluding us from performing a comprehensive evaluation of safety aspects of hormonal contraceptive agents. The quality of all primary studies included in each meta-analysis relied on the assessment reported by the respective meta-analysis. Most systematic reviews and meta-analyses included in our review were focused on estrogen-containing combined oral contraceptive agents. When drawing conclusions about clinical practice from the findings of this umbrella review, it is necessary to be mindful that progestin-only methods (ie, progesterone-only tablets, depot medroxyprogesterone acetate injections, progesterone implants, and levonorgestrel-releasing intrauterine systems) are not represented in a clinically meaningful way. However, the conclusions drawn from the combined oral contraceptive data do have implications for clinical practice.