Choosing among anchored indirect comparison methods in health technology assessment: simulation evidence and a practical decision framework

preprint OA: closed
Full text JSON View at publisher

Abstract

Abstract Background Decision makers in health technology assessment rely on network meta-analysis to synthesize incomplete head to head evidence, yet imbalances in effect modifiers can bias transported relative effects. Adjustment options include study-level and multilevel meta-regression, matching-adjusted indirect comparison, simulated treatment comparison, and network meta-interpolation. Comparative performance under graded violations of shared effect modification and practical guidance that links method choice to testable assumptions remain limited. Methods We built a four-trial anchored network and defined Trial 3 as the target population. Binary outcomes were generated on the probit scale with two covariates. We examined three scenarios for shared effect modification, namely shared, stronger interactions for treatment C by one half, and opposite directions. Each scenario had fifty replications. All methods estimated B versus C in the Trial 3 population on the probit scale. Performance metrics were bias, root mean squared error, and empirical coverage of the nominal ninety-five percent interval. Results ML-NMR showed the smallest bias and coverage closest to the nominal level across scenarios. Study-level NMR maintained reasonable precision when shared effect modification held but showed wider intervals and higher bias when interactions differed. MAIC and STC were nearly unbiased when shared effect modification was valid and key modifiers were correctly identified, but both developed bias and undercoverage when interaction strength or direction diverged. NMI was comparatively stable, with reliability dependent on covariance stability. Conventional NMA performed worst under pronounced covariate mismatch. Conclusions Analysts should first test prerequisite assumptions, including shared effect modification and homoscedasticity when relevant. Aligning method choice with verified assumptions reduces misspecification risk in health technology assessment and supports transparent, credible decisions.
Full text 19,405 characters · extracted from preprint-html · click to expand
Choosing among anchored indirect comparison methods in health technology assessment: simulation evidence and a practical decision framework | Research Square window.SnipcartSettings = { analytics: { enabled: false } }; (function() { var accessVector = localStorage.getItem('access_vector') || ''; window.dataLayer = window.dataLayer || []; if (accessVector) { window.dataLayer.push({ user: { profile: { profileInfo: { snid: accessVector } } } }); } })(); (function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src='https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);})(window,document,'script','dataLayer','GTM-K279D39R'); Browse Preprints In Review Journals COVID-19 Preprints AJE Video Bytes Research Tools Research Promotion AJE Professional Editing AJE Rubriq About Preprint Platform In Review Editorial Policies Our Team Advisory Board Help Center Sign In Submit a Preprint Cite Share Download PDF Research Article Choosing among anchored indirect comparison methods in health technology assessment: simulation evidence and a practical decision framework Lingyao Sun, Dachuang Zhou, Lei Tian This is a preprint; it has not been peer reviewed by a journal. https://doi.org/ 10.21203/rs.3.rs-7824621/v1 This work is licensed under a CC BY 4.0 License Status: Under Review Version 1 posted 10 You are reading this latest preprint version Abstract Background Decision makers in health technology assessment rely on network meta-analysis to synthesize incomplete head to head evidence, yet imbalances in effect modifiers can bias transported relative effects. Adjustment options include study-level and multilevel meta-regression, matching-adjusted indirect comparison, simulated treatment comparison, and network meta-interpolation. Comparative performance under graded violations of shared effect modification and practical guidance that links method choice to testable assumptions remain limited. Methods We built a four-trial anchored network and defined Trial 3 as the target population. Binary outcomes were generated on the probit scale with two covariates. We examined three scenarios for shared effect modification, namely shared, stronger interactions for treatment C by one half, and opposite directions. Each scenario had fifty replications. All methods estimated B versus C in the Trial 3 population on the probit scale. Performance metrics were bias, root mean squared error, and empirical coverage of the nominal ninety-five percent interval. Results ML-NMR showed the smallest bias and coverage closest to the nominal level across scenarios. Study-level NMR maintained reasonable precision when shared effect modification held but showed wider intervals and higher bias when interactions differed. MAIC and STC were nearly unbiased when shared effect modification was valid and key modifiers were correctly identified, but both developed bias and undercoverage when interaction strength or direction diverged. NMI was comparatively stable, with reliability dependent on covariance stability. Conventional NMA performed worst under pronounced covariate mismatch. Conclusions Analysts should first test prerequisite assumptions, including shared effect modification and homoscedasticity when relevant. Aligning method choice with verified assumptions reduces misspecification risk in health technology assessment and supports transparent, credible decisions. Simulation study Indirect comparison Shared effect modification Health technology assessment Full Text Additional Declarations No competing interests reported. Cite Share Download PDF Status: Under Review Version 1 posted Editorial decision: Revision requested 06 Mar, 2026 Reviews received at journal 16 Dec, 2025 Reviews received at journal 25 Nov, 2025 Reviewers agreed at journal 21 Nov, 2025 Reviewers agreed at journal 13 Nov, 2025 Reviewers invited by journal 12 Nov, 2025 Editor invited by journal 20 Oct, 2025 Editor assigned by journal 13 Oct, 2025 Submission checks completed at journal 13 Oct, 2025 First submitted to journal 10 Oct, 2025 You are reading this latest preprint version Research Square lets you share your work early, gain feedback from the community, and start making changes to your manuscript prior to peer review in a journal. As a division of Research Square Company, we’re committed to making research communication faster, fairer, and more useful. We do this by developing innovative software and high quality services for the global research community. Our growing team is made up of researchers and industry professionals working together to solve the most critical problems facing scientific publishing. Also discoverable on Platform About Our Team In Review Editorial Policies Advisory Board Help Center Resources Author Services Accessibility API Access RSS feed Manage Cookie Preferences © Research Square 2026 | ISSN 2693-5015 (online) Privacy Policy Terms of Service Do Not Sell My Personal Information {"props":{"pageProps":{"initialData":{"identity":"rs-7824621","acceptedTermsAndConditions":true,"allowDirectSubmit":false,"archivedVersions":[],"articleType":"Research Article","associatedPublications":[],"authors":[{"id":549216801,"identity":"0902d9a9-bfd5-4acc-8f71-f59a1e3353e1","order_by":0,"name":"Lingyao Sun","email":"","orcid":"","institution":"China Pharmaceutical University","correspondingAuthor":false,"prefix":"","firstName":"Lingyao","middleName":"","lastName":"Sun","suffix":""},{"id":549216802,"identity":"128d2a9f-9b73-4d8c-9982-4d1b576ef5c8","order_by":1,"name":"Dachuang Zhou","email":"","orcid":"","institution":"China Pharmaceutical University","correspondingAuthor":false,"prefix":"","firstName":"Dachuang","middleName":"","lastName":"Zhou","suffix":""},{"id":549216803,"identity":"9301ee6f-897d-401b-9b06-19ff5c73c70b","order_by":2,"name":"Lei Tian","email":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAZAAAAAyAQMAAABI0h/eAAAABlBMVEX///8AAABVwtN+AAAACXBIWXMAAA7EAAAOxAGVKw4bAAAAyUlEQVRIie3QsQrCMBCA4ZNCdDjJJhHFvkKKgw6Cr5LuDro7FASnomtLX6KPUDno5BvYoSA4x0U6iXEW2owO+beDfBwXAJfrX1MAU/C8otCNHehFhiB4LLyksS2BLwGc04BZvOdZvKjrfYW8j5qM9PmoaCeiugaRKh84Pgxz2i4hSDPVTqTYGMIIJRmSICh5syJvwjVhTchsSXg0WzwEOyKqcpeEJ0JBTJpPFt238OyQP5sXzfiZ7lo3K59POgiI1tGGuFwul+u3D0xbRB7Yc4sjAAAAAElFTkSuQmCC","orcid":"","institution":"China Pharmaceutical University","correspondingAuthor":true,"prefix":"","firstName":"Lei","middleName":"","lastName":"Tian","suffix":""}],"badges":[],"createdAt":"2025-10-10 08:38:46","currentVersionCode":1,"declarations":"","doi":"10.21203/rs.3.rs-7824621/v1","doiUrl":"https://doi.org/10.21203/rs.3.rs-7824621/v1","draftVersion":[],"editorialEvents":[],"editorialNote":"","failedWorkflow":false,"files":[{"id":96642133,"identity":"f1bc7794-ad2d-49f3-a657-1ad31357ef5f","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"docx","order_by":0,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":1287630,"visible":true,"origin":"","legend":"","description":"","filename":"Manuscript.docx","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/9c95dfc415be89523a115f77.docx"},{"id":96642132,"identity":"04e98f99-971e-469b-abd4-948bd5dd3889","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"json","order_by":1,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":5978,"visible":true,"origin":"","legend":"","description":"","filename":"ed636bd7b2dd42699481ff6991f66d07.json","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/806309554e4568f870fa31ea.json"},{"id":96709761,"identity":"e16845e1-f5ea-4e3c-82b9-77602eb85c66","added_by":"auto","created_at":"2025-11-25 10:09:37","extension":"xml","order_by":2,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":116924,"visible":true,"origin":"","legend":"","description":"","filename":"ed636bd7b2dd42699481ff6991f66d071enriched.xml","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/83b9d4f9e3c9b31e64ab4bb5.xml"},{"id":96709198,"identity":"97131818-e4ca-4166-8ee7-14f3f7a9153b","added_by":"auto","created_at":"2025-11-25 10:08:12","extension":"png","order_by":3,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":237230,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/efb2f8e178b417a5465d6c83.png"},{"id":96642142,"identity":"6e0fb123-6ef9-4ccd-b4bc-22ef96acbcc0","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"png","order_by":4,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":525810,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/601cac68c8135babbefd83c6.png"},{"id":96642134,"identity":"60709987-c26c-4dca-8c6a-11e68c4523b7","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"png","order_by":5,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":24661,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage3.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/4d1ab74bf097b1687def8eea.png"},{"id":96709274,"identity":"54c0f38f-8c0d-4fea-ba5b-46dc834be684","added_by":"auto","created_at":"2025-11-25 10:08:34","extension":"png","order_by":6,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":116394,"visible":true,"origin":"","legend":"","description":"","filename":"floatimage4.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/574a505e7ec0388222639742.png"},{"id":96642141,"identity":"01ed10dd-1d68-4335-8468-330eda1df680","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"png","order_by":7,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":66231,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage1.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/2103260aefe5d78d4e9c499e.png"},{"id":96642135,"identity":"bd505cb4-4c0f-410e-8047-c92a2ed64d7d","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"png","order_by":8,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":60535,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage2.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/23c3887dde103c9ac97cfefb.png"},{"id":96642139,"identity":"c49364fb-d776-4e22-9a93-bbe8f333bae6","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"png","order_by":9,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":24402,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage3.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/97d13a932d464bc75732e185.png"},{"id":96710236,"identity":"1161e7e1-fd76-4499-9542-6f11e80a9c9f","added_by":"auto","created_at":"2025-11-25 10:10:20","extension":"png","order_by":10,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":44174,"visible":true,"origin":"","legend":"","description":"","filename":"Onlinefloatimage4.png","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/711102db7de13754a09a076b.png"},{"id":96642144,"identity":"f412eb81-080c-4ed6-b9bb-96ef900e9ca3","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"xml","order_by":11,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":115105,"visible":true,"origin":"","legend":"","description":"","filename":"ed636bd7b2dd42699481ff6991f66d071structuring.xml","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/8558e772c53f1734a93f8c49.xml"},{"id":96642143,"identity":"d7f1d74e-6810-4a27-ac86-5593485cb0e5","added_by":"auto","created_at":"2025-11-24 14:51:30","extension":"html","order_by":12,"title":"","display":"","copyAsset":false,"role":"acdc-reference","size":131371,"visible":true,"origin":"","legend":"","description":"","filename":"earlyproof.html","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1/7d68178f738b96f3c03b804c.html"},{"id":96712802,"identity":"200a245e-e000-4fdb-b650-d6df19423e89","added_by":"auto","created_at":"2025-11-25 10:16:45","extension":"pdf","order_by":1,"title":"","display":"","copyAsset":false,"role":"manuscript-pdf","size":574906,"visible":true,"origin":"","legend":"","description":"","filename":"Manuscript.pdf","url":"https://assets-eu.researchsquare.com/files/rs-7824621/v1_covered_c6e35ff9-6705-4264-8c15-0ad011d52aaa.pdf"}],"financialInterests":"No competing interests reported.","formattedTitle":"Choosing among anchored indirect comparison methods in health technology assessment: simulation evidence and a practical decision framework","fulltext":[],"fulltextSource":"","fullText":"","funders":[],"hasAdminPriorityOnWorkflow":false,"hasManuscriptDocX":false,"hasOptedInToPreprint":true,"hasPassedJournalQc":"","hasAnyPriority":false,"hideJournal":false,"highlight":"","institution":"","isAcceptedByJournal":false,"isAuthorSuppliedPdf":true,"isDeskRejected":"","isHiddenFromSearch":false,"isInQc":false,"isInWorkflow":false,"isPdf":true,"isPdfUpToDate":true,"isWithdrawnOrRetracted":false,"journal":{"display":true,"email":"[email protected]","identity":"bmc-medical-research-methodology","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bmrm","sideBox":"Learn more about [BMC Medical Research Methodology](http://bmcmedresmethodol.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/bmrm/default.aspx","title":"BMC Medical Research Methodology","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true},"keywords":"Simulation study, Indirect comparison, Shared effect modification, Health technology assessment","lastPublishedDoi":"10.21203/rs.3.rs-7824621/v1","lastPublishedDoiUrl":"https://doi.org/10.21203/rs.3.rs-7824621/v1","license":{"name":"CC BY 4.0","url":"https://creativecommons.org/licenses/by/4.0/"},"manuscriptAbstract":"\u003ch2\u003eBackground\u003c/h2\u003e\u003cp\u003eDecision makers in health technology assessment rely on network meta-analysis to synthesize incomplete head to head evidence, yet imbalances in effect modifiers can bias transported relative effects. Adjustment options include study-level and multilevel meta-regression, matching-adjusted indirect comparison, simulated treatment comparison, and network meta-interpolation. Comparative performance under graded violations of shared effect modification and practical guidance that links method choice to testable assumptions remain limited.\u003c/p\u003e\u003ch2\u003eMethods\u003c/h2\u003e\u003cp\u003eWe built a four-trial anchored network and defined Trial 3 as the target population. Binary outcomes were generated on the probit scale with two covariates. We examined three scenarios for shared effect modification, namely shared, stronger interactions for treatment C by one half, and opposite directions. Each scenario had fifty replications. All methods estimated B versus C in the Trial 3 population on the probit scale. Performance metrics were bias, root mean squared error, and empirical coverage of the nominal ninety-five percent interval.\u003c/p\u003e\u003ch2\u003eResults\u003c/h2\u003e\u003cp\u003eML-NMR showed the smallest bias and coverage closest to the nominal level across scenarios. Study-level NMR maintained reasonable precision when shared effect modification held but showed wider intervals and higher bias when interactions differed. MAIC and STC were nearly unbiased when shared effect modification was valid and key modifiers were correctly identified, but both developed bias and undercoverage when interaction strength or direction diverged. NMI was comparatively stable, with reliability dependent on covariance stability. Conventional NMA performed worst under pronounced covariate mismatch.\u003c/p\u003e\u003ch2\u003eConclusions\u003c/h2\u003e\u003cp\u003eAnalysts should first test prerequisite assumptions, including shared effect modification and homoscedasticity when relevant. Aligning method choice with verified assumptions reduces misspecification risk in health technology assessment and supports transparent, credible decisions.\u003c/p\u003e","manuscriptTitle":"Choosing among anchored indirect comparison methods in health technology assessment: simulation evidence and a practical decision framework","msid":"","msnumber":"","nonDraftVersions":[{"code":1,"date":"2025-11-24 14:51:25","doi":"10.21203/rs.3.rs-7824621/v1","editorialEvents":[{"type":"communityComments","content":0},{"type":"decision","content":"Revision requested","date":"2026-03-06T11:53:18+00:00","index":"","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-12-16T17:12:42+00:00","index":"hide","fulltext":""},{"type":"editorInvitedReview","content":"","date":"2025-11-25T22:01:05+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"96154703358395709277319569641713722322","date":"2025-11-21T09:29:23+00:00","index":"hide","fulltext":""},{"type":"reviewerAgreed","content":"75138125432393766497426597204922396323","date":"2025-11-13T14:18:41+00:00","index":"hide","fulltext":""},{"type":"reviewersInvited","content":"","date":"2025-11-12T17:43:27+00:00","index":"","fulltext":""},{"type":"editorInvited","content":"","date":"2025-10-20T20:27:27+00:00","index":"","fulltext":""},{"type":"editorAssigned","content":"","date":"2025-10-13T09:53:17+00:00","index":"","fulltext":""},{"type":"checksComplete","content":"","date":"2025-10-13T09:50:42+00:00","index":"","fulltext":""},{"type":"submitted","content":"BMC Medical Research Methodology","date":"2025-10-10T08:26:35+00:00","index":"","fulltext":""}],"status":"published","journal":{"display":true,"email":"[email protected]","identity":"bmc-medical-research-methodology","isNatureJournal":false,"hasQc":true,"allowDirectSubmit":false,"externalIdentity":"bmrm","sideBox":"Learn more about [BMC Medical Research Methodology](http://bmcmedresmethodol.biomedcentral.com/)","snPcode":"","submissionUrl":"https://www.editorialmanager.com/bmrm/default.aspx","title":"BMC Medical Research Methodology","twitterHandle":"BMC_series","acdcEnabled":true,"dfaEnabled":false,"editorialSystem":"em","reportingPortfolio":"BMC Series","inReviewEnabled":true,"inReviewRevisionsEnabled":true}}],"origin":"","ownerIdentity":"40135ea9-be68-408e-8fa4-01e9c8dc6624","owner":[],"postedDate":"November 24th, 2025","published":true,"recentEditorialEvents":[],"rejectedJournal":[],"revision":"","amendment":"","status":"under-review","subjectAreas":[],"tags":[],"updatedAt":"2026-03-11T05:55:01+00:00","versionOfRecord":[],"versionCreatedAt":"2025-11-24 14:51:25","video":"","vorDoi":"","vorDoiUrl":"","workflowStages":[]},"version":"v1","identity":"rs-7824621","journalConfig":"researchsquare"},"__N_SSP":true},"page":"/article/[identity]/[[...version]]","query":{"redirect":"/article/rs-7824621","identity":"rs-7824621","version":["v1"]},"buildId":"8U1c8b4HqxoKbykW_rLl7","isFallback":false,"isExperimentalCompile":false,"dynamicIds":[84888],"gssp":true,"scriptLoader":[]}

Text is read by the "Ask this paper" AI Q&A widget below. Extraction quality varies by source — PMC NXML preserves structure cleanly, OA-HTML may include some navigation residue, and OA-PDF can have broken hyphenation. The publisher copy (via DOI) is the canonical version.

My notes (saved in your browser only)

Ask this paper AI returns verbatim quotes from the full text · source: preprint-html

Answers must be backed by verbatim quotes from this paper's full text. Hallucinated quotes are dropped automatically; if no verbatim passage answers the question, we say so. How this works

Citation neighborhood (no data yet)

We don't have any in-corpus citations linked to this paper yet. This is a recent paper (2025) — citers typically take a year or two to land, and the OpenAlex reference graph may still be filling in.

Source provenance

europepmc
last seen: 2026-05-20T01:45:00.602351+00:00