This report is available in PDF only (Final Report [PDF, 762 KB]; Appendix A [1016.2 KB]). People using assistive technology may not be able to fully access information in these files. For additional assistance, please contact us.
Key Messages
- We developed an online interactive tool that allows users to obtain descriptive and analytic results for a systematic review comparing at least three treatments in various populations.
- In a limited evaluation, stakeholders were satisfied with the functionality of the tool and found it easy to use.
- We organized stakeholder feedback in three themes, namely expository, analytic, and information-sharing augmentations. We propose that a roadmap to realizing these augmentations involves the following: (i) integrating analytic capabilities, (ii) incorporating ways to assess the tradeoffs between several distinct benefits and harms of interventions with minimal assumptions, (iii) defining an information technology standard for systematic reviews, and (iv) developing a rigorous representation of evidence synthesis objects as mathematical graphs.
Structured Abstract
Background. Systematic reviews are consumed by different types of users to address an ever-expanding set of questions and needs. It is unlikely that a single static report will efficiently satisfy the diverse needs of diverse users. It might be practical and satisfactory to give users the ability to generate their own report from the information produced by the systematic review.
Methods. We developed an open-source web-based interactive report presentation (IRP) of a systematic review on 14 nonsurgical treatments for Urinary Incontinence (UI) in women. We used data from a systematic review we conducted through the Agency for Healthcare Research and Quality Evidence-based Practice Center Program for the Patient Centered Outcomes Research Institute. We presented wireframes (mockups) of the IRP to a panel of three Duke Health System stakeholders in teleconferences, and incorporated their feedback in the final IR, which includes a visual representation of the evidence base, and allows users to access generic or detailed descriptive and analytic information through a point-and-click interface. Subsequently, the stakeholders piloted the IRP and evaluated its ease of use by answering open ended questions. We proposed a roadmap for scalable IRPs of systematic reviews starting from a thematic analysis of these suggestions.
Findings. The final tool allows users to obtain descriptive and analytic results for a network of 14 treatment categories, various outcomes (cure, improvement, satisfaction, quality of life) and several subgroups (all women, older women, or those with stress or urge UI). Users can access descriptions overall or for specific sets of studies. The stakeholders were satisfied with the functionality of the tool, and commented on its ease of use. They proposed numerous augmentations, which we organized in themes of presentation (e.g., present information on numbers of trials on figures), analytic (e.g., allow on-the-fly subgroup analyses, explore tradeoffs between several outcomes) and information sharing (e.g., ability to import/export data from/to other software). A roadmap to satisfying these augmentations involves the following: (i) integrating analytic capabilities in the tool, (ii) incorporating ways to assess the tradeoffs between several distinct benefits and harms of interventions with minimal assumptions, (iii) defining an information technology standard for evidence synthesis objects (i.e., what information, in in what format, completely describes an evidence-base and its synthesis), and (iv) developing a rigorous representation of evidence synthesis objects as mathematical graphs that can be analyzed.
Conclusions. In sum, we described a foray into an alternative view of a systematic review that complements a static systematic review report. Health system representatives found it useful and practical, and requested analytical, expository, and information sharing augmentations to the tool.
Journal Citation
Adam GP, Balk EM, Jap J, et al. AHRQ EPC series on improving translation of evidence: Web-based interactive presentation of systematic review reports. Jt Comm J Qual Patient Saf. 2019 Sept;45(9):629-38. DOI: https://doi.org/10.1016/j.jcjq.2019.05.001.
Citation
Suggested citation: Trikalinos TA, Adam GP, Jap J, Senturk B, Springs S, Sanders-Schmidler G, Lallinger K, Butler M, Brassure M, Banez L, Berliner E, Gozu A, Balk E. Web Interactive Presentation of EPC Reports: A Foray Into Interactive Reports. Methods Research Report. (Prepared by the Brown, Duke, and Minnesota Evidence-based Practice Centers under Contract No. 290-2015-00002-I.) AHRQ Publication No. 19-EHC003-EF. Rockville, MD: Agency for Healthcare Research and Quality. September 2019. Posted final reports are located on the Effective Health Care Program search page. https://doi.org/10.23970/AHRQEPCMETHENGAGEINTERACTIVE.