Background styles in systematic review articles: a cross-sectional study protocol

Background styles in systematic review articles: a cross-sectional study protocol Authors: Yuki Kataoka, MD, MPH, DrPH 1),2),3),4), Shunsuke Taito, PT PhD 3),5), Sachiko Yamamoto-Kataoka, MD, MPH, PhD ,6), Yasushi Tsujimoto, MD, MPH 3),6),7), Hajime Yamazaki, MD, PhD 2), Toshi A. Furukawa, MD, PhD8) Affiliations: 1 Hospital Care Research Unit, Hyogo Prefectural Amagasaki General Medical Center, Higashinaniwa-cho 2-17-77, Amagasaki 660-8550 JAPAN 2 Department of Community Medicine in the Graduate School of Medicine, Kyoto University , Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501, JAPAN 3 Systematic Review Workshop Peer Support Group (SRWS-PSG), Japan 4 Department of Respiratory Medicine, Hyogo Prefectural Amagasaki General Medical Center, Higashinaniwa-cho 2-17-77, Amagasaki 660-8550 JAPAN 5 Division of Rehabilitation, Department of Clinical Practice and Support, Hiroshima University Hospital, Kasumi 1-2-3, Minami-ku, Hiroshima, 734-8551 Japan . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint NOTE: This preprint reports new research that has not been certified by peer review and should not be used to guide clinical practice. 6 Department of Healthcare Epidemiology, Graduate School of Medicine and Public Health, Kyoto University, Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501, JAPAN 7 Department of Nephrology and Dialysis, Kyoritsu Hospital, 16-5 Chuo-cho, Kawanishi, Hyogo 666-0016, Japan 8 Department of Health Promotion and Human Behavior, School of Public Health in the Graduate School of Medicine, Kyoto University, Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501, Japan Corresponding author: Toshi A Furukawa Department of Health Promotion and Human Behavior, School of Public Health in the Graduate School of Medicine, Kyoto University, Yoshida Konoe-cho, Sakyo-ku, Kyoto 606-8501, Japan Phone: +81-75-753-9491 Fax: +81-75-753-4641 Email: [email protected] . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint Abstr a ct Ba c k gr oun d: Th e b ack grou nd s e ction of a m edical jou r n al article has t he i mportan t fu nc t ion to c om mun icat e re ad ers t he va l u e of t he r ese arc h qu estion. H o w e v er , little is kn o w n a bo ut ho w auth ors d esc ri be th eir " niche" to em phasize th e imp ortan ce of t heir resear c h q u estion. Thi s study aims to ex amin e the m etho ds the auth ors us e in ord er to delin eat e t heir nich e in sys tem at ic re v i ews (SR). M e t ho ds : W e will cond uc t a c ros s-sectional stud y . W e w i ll inc l ude Origin al SR ar t ic les pu blis h ed in t op 5 0 jour nals in ME D I C I NE , G E N E RAL & INT ERN AL cat e g o ry in Jo urn al C i tation R e p orts 201 8. W e will c ond u c t cont ent an alysis o f b ack gro und s ec t io n s . T he pr imar y ou tc om e will be wh e t h er th e article w as pu blishe d in top 1 0 jo ur n al or n ot. W e will use c h i-s q uar e d tes t and lo gist ic reg res si on an alysis . T he primar y a nalys is will be l ogistic reg r ess i on pred ic ti ng pu blic at ion in high im pact jour nals, wit h c o variat es . T w o-tail e d p valu es will be c o ns i d e r ed s tat is tica lly s ignif ic ant if les s than 0.05. Disc u s sio n: This is t he f ir st s tudy to inv estigate th e infl uence of w h a t to pres e n t an d n ot prese nt i n the bac k gr ou nds s ec t ion to be a cc e pte d in t he h ighly c it e d journ al s a m o n g S R articles . . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint Back gro un ds: T he b ack grou nd s ec t io n of a me dic al journ al ar t ic le has the impor t an t function to comm unicate re ad er s th e valu e of the re s ear c h qu es t ion. Th ere a re m a n y te xtbo o ks an d re view articles o n h ow to w r i te it based on exp ert opini ons (1 –3). In addition, t he r e ar e se ve r al an alyses th at exa mine d its structure in medic al re s e ar ch a rticl es. Th e bas i c structure of t he back groun d s ection m ay b e cha r acterized as follo w s: “ es t ablis hi ng a t e rritor y” , “es t ablis hi ng a nic h e” , an d “oc cup yin g the nich e” (4,5). Ho w eve r , little is known ab o ut how auth o rs d esc rib e th e ir " niche" t o e mph asize the im po rtan ce of their resea r ch q ues ti on. Thi s s t udy aim s to ex amin e the m e t ho ds the aut ho r s use in orde r t o d elin eat e th e i r nich e in syste matic re vie w s (SR). W e h av e focus e d o n S Rs b ec ause SRs ar e t he m o st imp ortant res e arch d esig n, in terms of prac t ic i ng e vid e nc e - base d me dic i n e (6) . M e sh ods: P r otoc o l : W e f o llo w ed th e r e p orting g uid eline of meta-e pid emiol o gic al study t o pre p ar e thi s prot ocol (7). W e will publ is h t his pr otoc o l in medR xiv ( ht tps ://ww w .m edr xi v .or g/ ). . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint S tudy d es i gn: W e will con duct a c r os s-se ction al stud y . Eligibilit y criter ia: Origin al SR articles pu blished in t o p 5 0 jo urn als in M EDICINE, G E N E RAL & I NTERN A L cat e g ory i n J o u rnal Citation Re p or t s 20 18 (8). W e sh o w the lists in table 1. W e will in c lud e article s p ublish ed in 20 18. W e w i ll inc l ud e al l SR articles irr es pe c ti v e of in c lude d prima ry s t ud y des i gn s . T h e definition o f SR is “a sc ient i fic invest igation t hat focus e s o n a s p ecific qu e sti o n an d u s es explicit, pres p ecified s ci entif ic meth ods to ident ify , sel ec t , asses s, a nd sum mar iz e the findin g s of similar bu t s e par ate s t udies .” (9). W e w i ll e xc lud e Coc h ran e R evie ws o r the U.S. P rev e ntive S er vices T ask Force r e view be cause t h eir backgr oun ds s tyles ar e presp e cified b y the r e sp ec t iv e o rg an izations an d dif fer ent from us ual or igin al articles (10, 1 1). I nfor mat ion S our c es : P ubM ed, W eb o f Sc ie nc e Se a r c h: W e will search Pu bM e d. T h e det ails o f sear ch f or mu la ar e s h ow n in T abl e 2 A, an d 2 B . . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint S tudy s e lection: On e revi ew auth or (YK) will co n fir m wh ether th e artic l e s are S R or n ot. E x p o su r e s: F o u r as p ec t s t hat one can emp hasiz e a bo ut on e’ s re s e ar ch q u estion in the back grou nd sec t ion m ay b e s umma riz e d as follo ws: “nov elty”, “ s cop e ” , “qualit y”, and “u pd at e”. “ No velt y ” me ans a c om pletel y n e w r esear c h q uestio n. “ Sco pe” me ans th at t her e are re p orts related t o th e r es ear c h qu estion, but au thor s ex pa n ded or l i m i te d t h e P IC O . “ Quality” means that there are r e p or ts r elated t o th e r ese ar ch qu es t ion, bu t there w ere met hod olo gical flaws . “ Update” me ans that t her e w e r e s a me r e p orts, but th e se ar ch date was n e w . W e w i ll co n du c t c ont ent anal ysis of the firs t 10 articles inde p e n d ent ly by four revi e w aut ho r s (YK, ST , Y T , o r HY). W e will d evel op a d e t ailed guid e f rom th e init ial r evi e w . W e will res olv e dis ag re e m e nt s t hr oug h t he dis cuss i on, aft e r that two of four rev iew a uthor s will c ond u c t c ont en t an al ys is of the r es t . W e will resolv e disa gre em ents t hr ou gh the discus sion. If ne c es s ar y , an other thir d revi ew e r will ac t as an a r biter . W e will ad d o t h er categ or i es th r o ug h t he revie w if necess a r y . W e will asse ss th e a gre em e n t wi t h kapp a . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint valu es. P r imary outc o m e: T he pr imar y ou tc om e will be wh e t h er th e article w as pu blishe d in top 1 0 jo ur n al o r n ot. Data it ems : Details ar e sh o w n in T abl e 3. C ons i derin g t hat p ap ers pu blishe d in top journ als will ha v e ma ny c i t a t io n s , w e de f in e d c o n f o und i ng s f o l l o w i ng p re v io u s s t u di e s wh i c h in vestigated t h e pr og n o stic factor s for incre as e d c it ations ( 12–15) . W e will r etr i e v e som e dat a fro m W e b of Scie nce a pplication pro gr a mmi ng interf ace u s ing P ytho n 3.7. 4 software pr o g ra m (Pyt ho n S oftware Fou n d ation, De, US A). S tatis tical analysis : W e will use d e scr i pt ive stati s ti c s to s u m mar ize. W e will u s e chi -s quar e d tes t an d logistic re gres sion a nal ys is. The p r imar y anal ysis will be logistic reg res si o n pr e dicting pu blic at ion i n high impa ct journ als , with cov ar iat e s as lis t e d ab ov e. T wo -t ailed p valu e s will be consid e r e d statist ically significant i f les s t han 0. 05. W e will u s e St ata v er . 16. 0 (S tataCorp L L C, Colle g e Station, T ex as, United St ates of Am er ic a). W e d etermin ed th e sampl e s i z e as bel ow: w e will us e 4 e x po s ur e s a nd 5 conf oun di n gs . W e n e ed 90 e v ents for . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint t he vali dity of th e l og i s t ic mo del (1 6). W e w il l rand oml y select 90 ar t ic les fr o m th e t op 10 journ als an d 9 0 ar ti c les fr om th e 1 1 th to 5 0 th jo ur na l a s c o n tr o l . Disc u s sion: T his is t he fir s t s tu dy to inv es t iga t e the influe nc e of wh a t to pr e s ent an d n ot pr es ent in t he back gr o un ds se c ti o n t o be acce pte d in t he highl y c it ed journ als am on g S R articles . T here ar e se v e ral l imitati o n s . W e w ill not as ses s t he meth o d ol ogical qu alit y of e ac h articles du e to t he difficulty to sc ore t he qu alit y in single me asurem ent. For e x ampl e, AMST AR 2 ( 17), which is t he m ost famous ass e ssm ent t oo l, only account s for in ter v ention S R s. W e w il l not t ake into acc o un t t he c lin ic al s ignif ic ance of th e r e vie w , which is a confo un din g f ac t or , b ut it i s difficul t to e v alu at e o n o n e sc ale. T he r esu lts o f t his stu dy will be a goo d h elp f or s ys t e m atic r evi e w aut h o rs n o t o n ly wh e n t hey write the b ack grou nd s ec tion, b u t als o wh en the y thi nk a b o u t r es earch qu es ti o ns. . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint T abl e 1. T o p 50 j ourn als i n ME D I C I NE, G E N E RAL & INTE R N AL c ate g o ry c at e g orized in Journ al Citation R e ports 201 8 NEW EN G L A N D J O U R N A L OF M EDICINE LA NCE T JAM A-J OUR N A L O F T H E AM E R I CAN M EDIC AL AS S OC I ATI O N Nat ure Re vie ws Dis e as e Prim er s BMJ- Br i tish Medic al J o urn al JAM A Int e rn al Me dicine AN N A LS OF INTE R N AL M E DICIN E P LOS M EDICIN E Jo urn al of Cach e xia S ar c op en ia an d Musc le BM C Me dic i ne C oc hr an e D at a base of System atic R e vie w s M A Y O CLI NIC P R O C EE D I NG S C A N A DIAN M EDIC A L ASS O CI ATI O N J O URN AL JO U R N AL O F I N T ERN A L M EDICINE Jo urn al of C li nic al M edi c in e M E DI CAL J O U RN A L OF AUST R A L IA PA LL I A T I V E ME D IC IN E AMY LOID- JO U R N AL OF P R O T E I N FOLDIN G D I SO RD ERS T r anslation al R ese arc h AM E R I CAN J OUR NAL OF M EDICINE J OUR NA L OF GE NER A L IN T E RNA L ME D I C I NE De utsche s Ar zte blatt In ternation al AM E R I CAN J OUR NAL OF P RE VEN TIVE M E DICIN E BR IT IS H J O URNA L O F GE NE RA L PR AC TI CE A NNA L S O F F A M I LY M ED I C I NE J OUR NA L OF T RAV E L ME D IC INE Eur op ean J our nal of Intern al Medici ne JO U R N AL O F TH E ROY A L S OCIET Y O F MEDI C I N E AM E R I CAN J OUR NAL OF CHIN ES E M E DICIN E P RE VENTIV E M E DI CINE J OUR NA L OF P A I N A ND SY M PTOM M A NA G E M E N T Fr o n ti e r s i n Me d i c ine AN N A LS OF MEDI C I NE P o l is h Archiv es of I nternal Me dic i ne- Pols k ie Ar c hiwu m Me dyc yn y W ewn e t r znej . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint JO U R N AL O F TH E FO RM OS A N M E DIC A L A SSO CIA TION BR IT IS H M E D IC A L BU LLE T I N EU ROP E A N JO U R N AL O F CLINI CAL INV EST IGATIO N PA IN ME D I C I NE U PSA L A JO UR NA L O F ME D IC A L SC I E NC ES M E DI CAL C L INICS OF N O R TH AM E R I CA KO RE A N JO U R N AL OF INT ER NAL M E DICIN E Q J M -A N I N TE RN A T IO NA L J OUR NA L OF M ED IC IN E I NTERN A T ION A L JOU RNAL OF C LI N I C AL P RACT ICE AM E R I CAN F A M ILY PHY SICIAN Jo urn al of the Am e rican Boa r d of F a mily Medicin e Dia gn ostics MI N E RVA ME D IC A BM C Family P ractice Ar chi v es of M edi c al Sci ence BMJ Op e n . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint Ta b le 2A Se ar c h f o r mu l a o f t o p 10 j o ur n a l s for mu la num ber of re f e r e nces #1 20 18[p dat] 13 29 62 3 #2 "Systemati c R e vi ew"[P ublication T yp e] 11 72 16 #3 "N Engl J Med"[journal] OR "Lancet"[journal] OR "JAMA"[journal] OR "Nat Rev Dis Primers"[journal] OR "BMJ"[journal] OR "JAMA Internal Medicine"[journal] OR "Ann Intern Med"[journal] OR "PLoS Med"[journal] OR "J Cachexia Sarcopenia Muscle"[journal] OR "BMC Med"[journal] 412907 #4 # 1 AN D # 2 AN D # 3 13 1 T abl e 2 B S ea r ch form ula o f top 1 2 to 50 j o urn als* for mu la numb er of re f e r e n c e s #1 20 18[p dat] 13 29 6 2 3 #2 "Systemati c R e vi ew"[P ublication T yp e] 11 72 1 6 #3 "Mayo Clin Proc"[journal] OR "Can Med Assoc J"[journal] OR "J Intern Med"[journal] OR "J Clin Med"[journal] OR "Med J Aust"[journal] OR "Palliat Med"[journal] OR Amyloid[journal] OR "Transl Res"[journal] OR "Am J Med"[journal] OR "J Gen Intern Med"[journal] OR "Dtsch Arztebl Int"[Journal][journal] OR "Am J Prev Med"[journal] OR "Br J Gen Pract"[journal] OR "Ann Fam Med"[journal] OR "J Travel Med"[journal] OR "Eur J Intern Med"[journal] OR "J R Soc Med"[journal] OR "Am J Chin Med"[journal] OR "Prev Med"[journal] OR "J Pain Symptom Manage"[journal] OR "Front Med (Lausanne)"[journal] OR "Ann Med"[journal] OR "Pol Arch Intern Med"[journal] OR "J Formos Med Assoc"[journal] OR "Br Med Bull"[journal] OR "Eur J Clin Invest"[journal] OR "Pain Med"[journal] OR "Ups J Med Sci"[journal] OR "Med Clin North Am"[journal] OR "Korean J Intern Med"[journal] OR "QJM"[journal] OR "Int J Clin Pract"[journal] OR "Am Fam Physician"[journal] OR "J Am Board Fam Med"[journal] OR "Diagnostics (Basel)"[journal] OR "Minerva Med"[journal] OR "BMC Fam Pract"[journal] OR "Arch Med Sci"[journal] OR "BMJ Open"[journal] 291774 #4 # 1 AN D # 2 AN D # 3 42 9 . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint * exc lu d e d C oc hr an e D at a base of Sys t em atic R e vie w s (11th r ankin g) s e ar c h da t e 20 19 / 12 / 01 . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint T able 3 d ata it ems Cat eg ory W hat? Ho w? Who? C u t-off Description Num ber o f p ara grap hs of bac kgro un d S imple cou nt ing On e revi ew aut h or Num ber o f c it e d articles i n bac kgro un d S imple cou nt ing On e revi ew aut h or W o rd co unt s in backgr oun d S imple cou nt ing On e revi ew aut h or S tudy typ e Ch eck visu ally On e revi ew aut h or interv e n tion diag n os t ic t e st acc u r ac y o r pr e diction pr o g nostic f ac tor o r p r eva l en c e other Area of re s e ar ch W OS API Pyt hon w it h w o s library E xp os ur e S tr u c tu r e of b ac k gr ou nd C onte nt anal ysis T w o re vi ew aut ho r s C onf oun d er s Num ber o f inc lu d e d articles in S R Ch eck visu ally On e revi ew aut h or Media n Num ber o f tables an d fi g u res Ch eck visu ally On e revi ew aut h or Media n P r es e n ce o f pr actice im plic at io n in discus sion or bac kgro un d Ch eck visu ally T w o re vi ew aut ho r s Num ber o f auth or s P ubM ed A P I Pyt hon with bio p ytho n librar y Media n P r es e n ce of ap p e n di x Ch eck visu ally Single r evie w a uthor . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint /circle6 S R : sys t emat ic re v i ew /circle6 API : Ap plication Pr o gr ammin g I nterface /circle6 WO S: W eb o f Sc ie n ce . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint Re f e r e nc e s 1. Al be rt T . Winn ing th e Publ i cat i on s Gam e. 4t h ed . C RC P re s s; 2017. 2. Silv ia PJ . W r it e i t Up. 1 st ed. A m er i c an P sy c h o l o g i ca l A s so ci at i o n ; 2019 . 3. Bl ig h , G l ennys Pa rs e l l J. A M EE G u id e N o. 17 : W rit ing f or j o u rn al publ i c a ti o n. M ed Tea ch [I n t e r n e t] . 1999 Jan 3 ;21 (5) :45 7– 68. Av ai lab l e f r om: htt p ://w w w.tand f on lin e . co m /d oi/ ful l /1 0 . 1080/ 0142 159 997912 1 4 . Nw o g u K N. T he me d ica l r es ear ch p a p er: Str uct ure a nd f u nc tio ns . En g lis h S pec i f Purp . 1 997 ;16(2 SPEC . ISS .) :119– 3 8. 5. Ji r apana k o r n N , T r aku lka s em suk W , Keyu rav on g S . M o v e Ana ly si s of Engl i s h R ese arc h Art icle Intro d uctio ns i n Th a i a n d I nt e r n at ion a l M ed ica l Jo urn a ls . 2014 ;17 (Jun e ):23 – 40. 6 . G u y a tt G , R e n n ie D , Me a de M, Coo k D. U ser s’ Gu i des to t he Med ic a l L i t e ra tur e: A Manual f o r E v id e n ce -B as ed Cl ini c al P rac ti ce . 2nd e d . M c Gr aw- Hi ll P r of es si on al; 2015 . 7 . M ur a d M H , W a n g Z . G u i de li nes f o r r epo rt in g me ta -e p id em iolo g ic al me tho dolog y r es ea r ch . E vid B as e d M e d [ I nt e rn e t] . 2 017 A ug ;2 2(4 ): 139–42. A v a il abl e f ro m : htt p :// eb m.b mj .c o m /l oo kup /d o i /10 .1136/ eb m e d -2017 -1107 13 8. InC it e s J o u r na l C ita ti on R ep or t s [ Int er net ] . [ cit e d 2019 O ct 3 ]. Avai labl e f r om : . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint h t tps : // jc r.c lari v a t e .co m/ J CR L a n d i ng P ag e A c t io n . actio n 9. M edi cin e I o f. Cl ini c al p r a c t i ce gu id e l i n es we c an t r u st . 2 0 11. 10. ME CIR Manua l | C o ch rane C o mmun it y [ I nt e rn et ]. [ c i t ed 2 019 O ct 3] . A vai lab l e fro m : h ttps : //c om m u n it y .co chr a ne.o r g/m e cir - m a n ua l 11. Fo rc e th e USPST. M e th od s and P r oc e s s es [ Int e r n e t ]. [ ci t ed 2019 O ct 3] . Av ai l a bl e fro m : h t tps : //w w w. us pre ve nt i ves e r v ice stas k f orc e.o rg/ P a g e/N a me /me t hods -a n d - pro ce sse s 12. Tahamtan I , S af ip ou r A f s har A, Ah a md zad e h K . Fa ct or s af f e ct ing nu mbe r o f c ita ti o n s : a co mp re h en siv e rev i ew o f th e l it e ratu r e . S c i en t om et ri c s. 2016 ;107 (3) :1195–225. 1 3 . R ost am i F , M oh a m m a d poo ras l A , H aj iza d e h M . T he e ffec t of c h a rac t e ris t ic s o f ti tle on cit at i o n ra t e s o f a rt i cl e s. S c i e n t o m e t r i cs . 20 14 ;98(3 ) :20 07–10 . 14. Roy l e P, Kandala N - B , Ba r nard K , W a u gh N. Bib li o m et r i c s o f s y s t e mat i c r evi e w s: analy si s o f c ita ti on rat es and j ou rna l i mpac t fa ct or s . S y st R ev [ Int er n e t ]. 20 1 3 S ep 12;2:74. Avai lab l e f ro m : h ttp :/ / www .n c b i.n lm .nih .g ov/pub m ed / 24028 37 6 15. M an r iq u ez J , C at ald o K, Harz I . F a c t or s in fl u en c ing c i tat i on s t o sy st emat i c re v i ew s in s kin di se a se s: a c ro ss - se c t i o na l stu dy th r ough W eb o f S ci en ce s a nd S c op u s . A n Bra s D e rma t ol [ Int er n et ] . 90( 5):646 –52. A va i l a bl e f ro m : . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint htt p ://w w w.n cbi . n l m.n ih . g o v/pu b m ed /2 65 60209 1 6 . P e d uz z i P , Co nca t o J , Ke m per E, Holfor d T R , Fe i nstei n A R . A s im u la t ion st u d y of t he n u m ber of e ve n ts pe r v ari a b le i n lo gis t ic r egr ess ion a n al y sis. J Cli n E p i dem io l [I nt e rn e t] . 19 96 D e c;49 (12) :1 37 3–9. Av ailabl e f r om : htt p s:/ /l ink inghub . e l s e vi e r . co m/ re t r i ev e /pi i/S089543569 60 02363 1 7 . S h e a B J, Ree ves BC , Wel ls G , T h u k u M, H ame l C, Mor a n J , e t al . AM S T AR 2 : a cr it ica l a p p r ais al tool for s y stem a tic re views t h a t inc l u de r a n dom is ed o r non - r and o m i sed st udi es o f h e a lt hc a re i nt e r v en ti o n s , o r bo th . B M J [ In t e r n e t] . 2 017 Sep 21;j40 08. Avai labl e f r om : h tt p :/ /w w w .b m j. co m /l o okup /d o i/10.1136 /bmj .j4 00 8 . CC-BY-ND 4.0 International licenseIt is made available under a is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. (which was not certified by peer review) The copyright holder for this preprint this version posted January 24, 2020. ; https://doi.org/10.1101/2020.01.19.20018127doi: medRxiv preprint