Performance of imaging interpretation, intra- and inter-reader agreement for diagnosis of pelvic endometriosis: comparison between an abbreviated and full MRI protocol

Purpose To compare the performance of imaging interpretation, intra- and inter-reader agreement between an abbreviated (aMRI) and full (fMRI) MRI protocol for diagnosis of pelvic endometriosis.

Seventy consecutive fMRI exams performed under suspicion of pelvic endometriosis were selected. Four radiologists (Rd) (1–10 years experience) independently evaluated presence/absence of endometriosis at 9 anatomic sites (AS). The readers evaluated aMRI (coronal T2 TSE volumetric images and axial T1 GRE fat-sat without contrast, extracted from fMRI) and fMRI protocols randomly, with at least 4 weeks interval between readings. The degree of confidence for diagnosis at each AS was evaluated with a 1–3 Likert Scale (1: low; 3: high). Intra- and inter-reader agreement between protocols were evaluated by kappa statistics and took reading experience into account. The gold standard for assessing the performance of imaging interpretation (sensitivity, specificity and accuracy) used a consensus reading of two other Rd (> 15 years experience).

There was no significant difference in the accuracy of imaging interpretation between the abbreviated (0.83–0.86) and full (0.83–0.87) protocols (p = 0.15). Intra-reader agreement between protocols ranged from substantial to almost perfect (0.74–0.96). A substantial inter-reader agreement was found for both protocols for readers with similar levels of experience (0.67–0.69) and in the global analysis (0.66 for both protocols). No difference was found in terms of degree of confidence between protocols, for all readers.

An abbreviated MRI protocol for pelvic endometriosis provided an accuracy of interpretation comparable to that of a complete protocol, with similar degrees of confidence and reproducibility, regardless the level of experience. Similar content being viewed by others

Jha P, Chamié LP (2020) Endometriosis MRI lexicon: consensus statement from the society of abdominal radiology endometriosis disease focused panel. Abdominal Radiology 45:1552–1568. Foti PV, Farina R, Palmucci S, Vizzini IA (2018) Endometriosis: clinical features, MR imaging findings and pathologic correlation. Insights into Imaging 9:149–172. Chamié LP, Blasbalg R, Pereira RMA (2011) Findings of Pelvic Endometriosis at Transvaginal US, MR Imaging, and Laparoscopy. RadioGraphics 31:77–100. Bazot M, Bharwani N, Huchon C (2017) European society of urogenital radiology (ESUR) guidelines: MR imaging of pelvic endometriosis. Eur Radiol 27:2765–2775. Canellas R, Rosenkrantz AB, Taouli B (2019) Abbreviated MRI Protocols for the Abdomen. RadioGraphics 39:758. Oldrini G, Derraz I, Salleron J (2018) Impact of an abbreviated protocol for breast MRI in diagnostic accuracy. Diagn Interv Radiol 24:12–16. Tillman BG, Gorman JD, Hru JM (2018) Diagnostic per-lesion performance of a simulated gadoxetate disodium-enhanced abbreviated MRI protocol for hepatocellular carcinoma screening. Clin Radiol 73:485-493. Kuhl CK, Schrading S, Strobel K, et al (2014) Abbreviated breast magnetic resonance imaging (MRI): first postcontrast subtracted images and maximum-intensity projection-a novel approach to breast cancer screening with MRI. J Clin Oncol 32:2304–2310. Stanzione A, Ponsiglione A (2019) Abreviated Protocols versus Multiparametric MRIf or Assessment of extraprostatic extension in prostatic carcinoma: a multireader study. Anticancer Res 39:4449–4454. Scardapane A, Lorusso F, Ferrante A (2014) Standard high-resolution pelvic MRI vs. low-resolution pelvic MRI in the evaluation of deep infiltrating endometriosis. Eur Radiol 24:2590–2596. Bazot M, Stivalet A, Darai E (2013) Comparison of 3D and 2D FSE T2-weighted MRI in the diagnosis of deep pelvic endometriosis: Preliminary results. Clin Radiol 68:47–54. Taylor HS, Adamson GD (2018) An evidence‐based approach to assessing surgical versus clinical diagnosis of symptomatic endometriosis. J Gynaecol Obstet 142:131–142. Coutinho A, Bittencourt LK, Pires CE (2011) MR Imaging in Deep Pelvic Endometriosis: A Pictorial Essay1. RadioGraphics 31:549–567. Bai X, Sun SM, Xu W MRI-based Bosniak Classification of Cystic Renal Masses, Version 2019: Interobserver Agreement, Impact of Readers’ Experience, and Diagnostic Performance. Radiology 2020:. https://doi.org/10.1148/radiol.2020200478. Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psycholl Bull 76:378. Landis K JR, G.G. (1977) The Measurement of Observer Agreement for Categorical Data. Biometrics 33:59–174. DeLong ER, DeLong DM (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44:837–845. Hawass NE (1997) Comparing the sensitivities and specificities of two diagnostic procedures performed on the same group of patients. Br J Radiol 70:360–366. Mugler JP (2014) Optimized three‐dimensional fast‐spin‐echo MRI. J Magn Reson Imaging 39:745–767. Busse RF, Brau ACS, Vu A, et al (2008) Effects of refocusing flip angle modulation and view ordering in 3D fast spin echo. Magn Reson Med 60:640–649. Siegelman ES, Oliver ER (2012) MR Imaging of Endometriosis: Ten Imaging Pearls. RadioGraphics 32:1675–1691. Tammaa A, Fritzer N, Lozano P, et al (2015) Interobserver agreement and accuracy of non-invasive diagnosis of endometriosis by transvaginal sonography: Observer agreement on TVS. Ultrasound Obstet Gynecol 46:737–740. Holland TK, Hoo WL, Mavrelos D, et al (2013) Reproducibility of assessment of severity of pelvic endometriosis using transvaginal ultrasound: Reproducibility of TVS in endometriosis. Ultrasound Obstet Gynecol 41:210–215. Chapron C, Fauconnier A, Vieira M (2003) Anatomical distribution of deeply infiltrating endometriosis: surgical implications and proposition for a classification. Hum Reprod 18:157–61. Saba L, Guerriero S, Sulcis R, Ajossa S, Melis G, Mallarini G (2010) Agreement and reproducibility in identification of endometriosis using magnetic resonance imaging. Acta Radiol 51:573-80. Mandrekar JN (2011) Measures of Interrater Agreement. Journal of Thoracic Oncology 6:6–7. Mohaghegh P, Rockall AG (2012) Imaging Strategy for Early Ovarian Cancer: Characterization of Adnexal Masses with Conventional and Advanced Imaging Techniques. RadioGraphics 32:1751–1773. Hricak H, Chen M, Coakley FV, et al (2000) Complex Adnexal Masses: Detection and Characterization with MR Imaging—Multivariate Analysis. Radiology 214:39–46. Saba L, Sulcis R, Melis GB (2014) Diagnostic confidence analysis in the magnetic resonance imaging of ovarian and deep endometriosis: comparison with surgical results. Eur Radiol 24:335-43. Jaramillo-Cardoso A, Shenoy-Bhangle A, Garces-Descovich A, et al (2020) Pelvic MRI in the diagnosis and staging of pelvic endometriosis: added value of structured reporting and expertise. Abdom Radiol 45:1623–1636. Barbisan CC, Andres MP, Torres LR, et al (2021) Structured MRI reporting increases completeness of radiological reports and requesting physicians’ satisfaction in the diagnostic workup for pelvic endometriosis. Abdom Radiol. https://doi.org/10.1007/s00261-021-02966-4 Chamié LP, Ribeiro DMFR, Tiferes DA, et al (2018) Atypical Sites of Deeply Infiltrative Endometriosis: Clinical Characteristics and Imaging Findings. RadioGraphics 38:309–328. Khandeparkar MS, Jalkote S, Panpalia M, et al (2018) High-resolution magnetic resonance imaging in the detection of subtle nuances of uterine adenomyosis in infertility. Global Reproductive Health 3:e14. Bazot M, Daraï E (2017) Diagnosis of Deep Endometriosis: Clinical Examination, Ultrasonography, Magnetic Resonance Imaging, and Other Techniques. Fertil Steril 108:886–894. Guerriero S, Condous G, van den Bosch T, et al (2016) Systematic approach to sonographic evaluation of the pelvis in women with suspected endometriosis, including terms, definitions and measurements: a consensus opinion from the International Deep Endometriosis Analysis (IDEA) group. Ultrasound Obstet Gynecol 48:318–332. Audebert A, Petousis S, Margioula-Siarkou C, et al (2018) Anatomic distribution of endometriosis: A reappraisal based on series of 1101 patients. Eur J Obstet Gynecol Reprod Biol 230:36–40. Chamié LP, Ribeiro DMFR, Ribeiro GMPAR, Serafini PC (2020) Postoperative imaging findings after laparoscopic surgery for deeply infiltrating endometriosis. Abdom Radiol 45:1847–1865. Funding This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors. Author information Authors and Affiliations Corresponding author Ethics declarations Conflict of interest There are no conflicts of interest to declare. Additional information Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Rights and permissions About this article Cite this article da Silva, L.L.C., Torres, U.S., Torres, L.R. et al. Performance of imaging interpretation, intra- and inter-reader agreement for diagnosis of pelvic endometriosis: comparison between an abbreviated and full MRI protocol. Abdom Radiol 46, 4025–4035 (2021). https://doi.org/10.1007/s00261-021-03052-5 Received: Revised: Accepted: Published: Version of record: Issue date: DOI: https://doi.org/10.1007/s00261-021-03052-5