Powered by the Evidence-based Practice Centers
Evidence Reports All of EHC
Evidence Reports All of EHC

SHARE:

FacebookTwitterFacebookPrintShare

Use of Mixed Treatment Comparisons in Systematic Reviews

Research Report Aug 23, 2012
Download PDF files for this report here.

Page Contents

People using assistive technology may not be able to fully access information in these files. For additional assistance, please contact us.

Structured Abstract

Objectives

To summarize publically available guidance for, and current use of, meta-analytic methods for mixed treatment comparison (MTC) evidence synthesis; to identify analyses using these methods and summarize their characteristics; to gain insight regarding the rationale for selection, implementation, and reporting of such methods from investigators.

Methods

In part one, we identified currently available guidance documents addressing the use of MTC in evidence synthesis by searching governmental agencies' and participating members' of the International Network of Agencies for Health Technology Assessment Web sites. Commonalities and disagreements among guidance documents were summarized qualitatively. Next, in part two, a systematic literature search for MTCs was undertaken. Characteristics of included analysis were summarized qualitatively. Last, in part three, we invited a random selection of nine investigators from the systematic literature search to participate in a focus group. Using a Web-based series of questions, we queried respondents regarding their opinion of network meta-analysis and how elements of MTC methodology were chosen in their identified analysis. Responses were summarized qualitatively.

Results

Guidance documents were typically written in a fashion to be applicable to network meta-analysis in general and not to a specific methodology. Guidance documents stressed Bayesian and Frequentist MTC approaches have strengths and limitations, while only one guidance document attempted to comprehensively address how to conduct a network meta-analysis and how to interpret and report results.

Our systematic review identified 42 MTCs of which the majority used Bayesian methods (80.9 percent). Bayesian analyses either used noninformative priors or did not report detail about priors used. Data regarding the evaluation of convergence, heterogeneity, and inconsistency were not consistently reported, and from those providing detail, it appears a broad range of methods were used.

Due to the infrequent use of Frequentist methods for MTC and poor response rate to our focus group invitation, all respondents had conducted a MTC using Bayesian methods. Consequently, we were unable to compare/contrast the viewpoints of investigators who used these two different methods.

Conclusions

Additional guidance on how and when to conduct a MTC, as well as how to interpret and report results is needed. Published meta-analyses using these methods varied in how they conducted and reported results.

Project Timeline

Use of Mixed Treatment Comparisons in Systematic Reviews

Sep 21, 2011
Topic Initiated
Aug 23, 2012
Research Report
Page last reviewed November 2017
Page originally created November 2017

Internet Citation: Research Report: Use of Mixed Treatment Comparisons in Systematic Reviews. Content last reviewed November 2017. Effective Health Care Program, Agency for Healthcare Research and Quality, Rockville, MD.
https://effectivehealthcare.ahrq.gov/products/mixed-treatment-comparisons/research

Select to copy citation