Reviews
21 April 2015

Electronic Health Record–Based Interventions for Improving Appropriate Diagnostic Imaging: A Systematic Review and Meta-analysis

Publication: Annals of Internal Medicine
Volume 162, Number 8

Abstract

Background:

One driver of increasing health care costs is the use of radiologic imaging procedures. More appropriate use could improve quality and reduce costs.

Purpose:

To review interventions that use the computerized clinical decision-support (CCDS) capabilities of electronic health records to improve appropriate use of diagnostic radiologic test ordering.

Data Sources:

English-language articles in PubMed from 1995 to September 2014 and searches in Web of Science and PubMed of citations related to key articles.

Study Selection:

23 studies, including 3 randomized trials, 7 time-series studies, and 13 pre–post studies that assessed the effect of CCDS on diagnostic radiologic test ordering in adults.

Data Extraction:

2 independent reviewers extracted data on functionality, study outcomes, and context and assessed the quality of included studies.

Data Synthesis:

Thirteen studies provided moderate-level evidence that CCDS improves appropriateness (effect size, −0.49 [95% CI, −0.71 to −0.26]) and reduces use (effect size, −0.13 [CI, −0.23 to −0.04]). Interventions with a “hard stop” that prevents a clinician from overriding the CCDS without outside consultation, as well as interventions in integrated care delivery systems, may be more effective. Harms have rarely been assessed but include decreased ordering of appropriate tests and physician dissatisfaction.

Limitation:

Potential for publication bias, insufficient reporting of harms, and poor description of context and implementation.

Conclusion:

Computerized clinical decision support integrated with the electronic health record can improve appropriate use of diagnostic radiology by a moderate amount and decrease use by a small amount. Before widespread adoption can be recommended, more data are needed on potential harms.

Primary Funding Source:

U.S. Department of Veterans Affairs. (PROSPERO registration number: CRD42014007469)

Get full access to this article

View all available purchase options and get full access to this article.

References

1.
Kocher KEMeurer WJFazel RScott PAKrumholz HMNallamothu BK. National trends in use of computed tomography in the emergency department. Ann Emerg Med. 2011;58:452-62. [PMID: 21835499]  doi: 10.1016/j.annemergmed.2011.05.020
2.
Korley FKPham JCKirsch TD. Use of advanced radiology during visits to U.S. emergency departments for injury-related conditions, 1998-2007. JAMA. 2010;304:1465-71. [PMID: 20924012]  doi: 10.1001/jama.2010.1408
3.
Chou RFu RCarrino JADeyo RA. Imaging strategies for low-back pain: systematic review and meta-analysis. Lancet. 2009;373:463-72. [PMID: 19200918]  doi: 10.1016/S0140-6736(09)60172-0
4.
Moher DLiberati ATetzlaff JAltman DGPRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151:264-9. [PMID: 19622511]
5.
Chaudhry BWang JWu SMaglione MMojica WRoth Eet al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med. 2006;144:742-52. [PMID: 16702590]
6.
Buntin MBBurke MFHoaglin MCBlumenthal D. The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Aff (Millwood). 2011;30:464-71. [PMID: 21383365]  doi: 10.1377/hlthaff.2011.0178
7.
Goldzweig CLOrshansky GPaige NMTowfigh AAHaggstrom DAMiake-Lye Iet al. Electronic patient portals: evidence on health outcomes, satisfaction, efficiency, and attitudes: a systematic review. Ann Intern Med. 2013;159:677-87. [PMID: 24247673]  doi: 10.7326/0003-4819-159-10-201311190-00006
8.
Jones SSRudin RSPerry TShekelle PG. Health information technology: an updated systematic review with a focus on meaningful use. Ann Intern Med. 2014;160:48-54. [PMID: 24573664]  doi: 10.7326/M13-1531
9.
Georgiou APrgomet MMarkewycz AAdams EWestbrook JI. The impact of computerized provider order entry systems on medical-imaging services: a systematic review. J Am Med Inform Assoc. 2011;18:335-40. [PMID: 21385821]  doi: 10.1136/amiajnl-2010-000043
10.
Roshanov PSMisra SGerstein HCGarg AXSebaldt RJMackay JAet alCCDSS Systematic Review Team. Computerized clinical decision support systems for chronic disease management: a decision maker–researcher partnership systematic review. Implement Sci. 2011;6:92. [PMID: 21824386]  doi: 10.1186/1748-5908-6-92
11.
Fillmore CLBray BEKawamoto K. Systematic review of clinical decision support interventions with potential for inpatient cost reduction. BMC Med Inform Decis Mak. 2013;13:135. [PMID: 24344752]  doi: 10.1186/1472-6947-13-135
12.
Borenstein MHedges LVHiggins JPTRothstein HR. Chapter 7: Converting among effect sizes. In: Borenstein M, Hedges LV, Higgins JPT, Rothstein HR, eds. Introduction to Meta-Analysis. Chichester, UK: J Wiley; 2011:45-9.
13.
Sánchez-Meca JMaríen-Martíinez FChacón-Moscoso S. Effect-size indices for dichotomized outcomes in meta-analysis. Psychol Methods. 2003;8:448-67. [PMID: 14664682]
14.
IntHout JIoannidis JPBorm GF. The Hartung–Knapp–Sidik–Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian–Laird method. BMC Med Res Methodol. 2014;14:25. [PMID: 24548571]  doi: 10.1186/1471-2288-14-25
15.
Bates DWKuperman GJJha ATeich JMOrav EJMa'luf Net al. Does the computerized display of charges affect inpatient ancillary test utilization? Arch Intern Med. 1997;157:2501-8. [PMID: 9385303]
16.
Tierney WMMcDonald CJHui SLMartin DK. Computer predictions of abnormal test results. Effects on outpatient testing. JAMA. 1988;259:1194-8. [PMID: 3339821]
17.
Harpole LHKhorasani RFiskio JKuperman GJBates DW. Automated evidence-based critiquing of orders for abdominal radiographs: impact on utilization and appropriateness. J Am Med Inform Assoc. 1997;4:511-21. [PMID: 9391938]
18.
Blackmore CCMecklenburg RSKaplan GS. Effectiveness of clinical decision support in controlling inappropriate imaging. J Am Coll Radiol. 2011;8:19-25. [PMID: 21211760]  doi: 10.1016/j.jacr.2010.07.009
19.
Carton MAuvert BGuerini HBoulard JCHeautot JFLandre MFet al. Assessment of radiological referral practice and effect of computer-based guidelines on radiological requests in two emergency departments. Clin Radiol. 2002;57:123-8. [PMID: 11977945]
20.
Chin HL, Wallace P. Embedding guidelines into direct physician order entry: simple methods, powerful results. Proceedings of the American Medical Informatics Association Annual Symposium, Washington, DC, 6–10 November 1999.
21.
Ip IKSchneider LSeltzer SSmith ADudley JMenard Aet al. Impact of provider-led, technology-enabled radiology management program on imaging. Am J Med. 2013;126:687-92. [PMID: 23786668]  doi: 10.1016/j.amjmed.2012.11.034
22.
Raja ASIp IKPrevedello LMSodickson ADFarkas CZane RDet al. Effect of computerized clinical decision support on the use and yield of CT pulmonary angiography in the emergency department. Radiology. 2012;262:468-74. [PMID: 22187633]  doi: 10.1148/radiol.11110951
23.
Rosenthal DIWeilburg JBSchultz TMiller JCNixon VDreyer KJet al. Radiology order entry with decision support: initial clinical experience. J Am Coll Radiol. 2006;3:799-806. [PMID: 17412171]
24.
Sistrom CLDang PAWeilburg JBDreyer KJRosenthal DIThrall JH. Effect of computerized order entry with integrated decision support on the growth of outpatient procedure volumes: seven-year time series analysis. Radiology. 2009;251:147-55. [PMID: 19221058]  doi: 10.1148/radiol.2511081174
25.
Curry LReed MH. Electronic decision support for diagnostic imaging in a primary care setting. J Am Med Inform Assoc. 2011;18:267-70. [PMID: 21486884]  doi: 10.1136/amiajnl-2011-000049
26.
Day FHoang LPOuk SNagda SSchriger DL. The impact of a guideline-driven computer charting system on the emergency care of patients with acute low back pain. Proc Annu Symp Comput Appl Med Care. 1995:576-80. [PMID: 8563351]
27.
Drescher FSChandrika SWeir IDWeintraub JTBerman LLee Ret al. Effectiveness and acceptability of a computerized decision support system using modified Wells criteria for evaluation of suspected pulmonary embolism. Ann Emerg Med. 2011;57:613-21. [PMID: 21050624]  doi: 10.1016/j.annemergmed.2010.09.018
28.
Durand DJFeldman LSLewin JSBrotman DJ. Provider cost transparency alone has no impact on inpatient imaging utilization. J Am Coll Radiol. 2013;10:108-13. [PMID: 23273974]  doi: 10.1016/j.jacr.2012.06.020
29.
Flamm MFritsch GHysek MKlausner SEntacher KPanisch Set al. Quality improvement in preoperative assessment by implementation of an electronic decision support tool. J Am Med Inform Assoc. 2013;20:e91-6. [PMID: 23599223]  doi: 10.1136/amiajnl-2012-001178
30.
Gupta AIp IKRaja ASAndruchow JESodickson AKhorasani R. Effect of clinical decision support on documented guideline adherence for head CT in emergency department patients with mild traumatic brain injury. J Am Med Inform Assoc. 2014;21:e347-51. [PMID: 24534635]  doi: 10.1136/amiajnl-2013-002536
31.
Soo Hoo GWWu CCVazirani SLi ZBarack BM, Does a clinical decision rule using D-dimer level improve the yield of pulmonary CT angiography? AJR Am J Roentgenol. 2011;196:1059-64. [PMID: 21512071]  doi: 10.2214/AJR.10.4200
32.
Ip IKGershanik EFSchneider LIRaja ASMar WSeltzer Set al. Impact of IT-enabled intervention on MRI use for back pain. Am J Med. 2014;127:512-8. [PMID: 24513065]  doi: 10.1016/j.amjmed.2014.01.024
33.
Sanders DLMiller RA. The effects on clinician ordering patterns of a computerized decision support system for neuroradiology imaging studies. Proc AMIA Symp. 2001:583-7. [PMID: 11825254]
34.
Solberg LIWei FButler JCPalattao KJVinz CAMarshall MA. Effects of electronic decision support on high-tech diagnostic imaging orders and patients. Am J Manag Care. 2010;16:102-6. [PMID: 20148614]
35.
Tierney WMMiller MEMcDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990;322:1499-504. [PMID: 2186274]
36.
Vartanians VMSistrom CLWeilburg JBRosenthal DIThrall JH. Increasing the appropriateness of outpatient imaging: effects of a barrier to ordering low-yield examinations. Radiology. 2010;255:842-9. [PMID: 20501721]  doi: 10.1148/radiol.10091228
37.
Raja ASGupta AIp IKMills AMKhorasani R. The use of decision support to measure documented adherence to a national imaging quality measure. Acad Radiol. 2014;21:378-83. [PMID: 24507424]  doi: 10.1016/j.ascra.2013.10.017
38.
Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Assoc; 1988.
39.
Strom BLSchinnar RAberra FBilker WHennessy SLeonard CEet al. Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial. Arch Intern Med. 2010;170:1578-83. [PMID: 20876410]  doi: 10.1001/archinternmed.2010.324
40.
Bowen SJohnson KReed MHZhang LCurry L. The effect of incorporating guidelines into a computerized order entry system for diagnostic imaging. J Am Coll Radiol. 2011;8:251-8. [PMID: 21458763]  doi: 10.1016/j.jacr.2010.11.020

Information & Authors

Information

Published In

cover image Annals of Internal Medicine
Annals of Internal Medicine
Volume 162Number 821 April 2015
Pages: 557 - 565

History

Published online: 21 April 2015
Published in issue: 21 April 2015

Keywords

Authors

Affiliations

Caroline Lubick Goldzweig, MD, MS
From West Los Angeles Veterans Affairs Medical Center and University of California, Los Angeles, Fielding School of Public Health, Los Angeles, and RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, California.
Greg Orshansky, MD
From West Los Angeles Veterans Affairs Medical Center and University of California, Los Angeles, Fielding School of Public Health, Los Angeles, and RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, California.
Neil M. Paige, MD, MSHS
From West Los Angeles Veterans Affairs Medical Center and University of California, Los Angeles, Fielding School of Public Health, Los Angeles, and RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, California.
Isomi M. Miake-Lye, BA
From West Los Angeles Veterans Affairs Medical Center and University of California, Los Angeles, Fielding School of Public Health, Los Angeles, and RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, California.
Jessica M. Beroes, BS
From West Los Angeles Veterans Affairs Medical Center and University of California, Los Angeles, Fielding School of Public Health, Los Angeles, and RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, California.
Brett A. Ewing, MS
From West Los Angeles Veterans Affairs Medical Center and University of California, Los Angeles, Fielding School of Public Health, Los Angeles, and RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, California.
Paul G. Shekelle, MD, PhD
From West Los Angeles Veterans Affairs Medical Center and University of California, Los Angeles, Fielding School of Public Health, Los Angeles, and RAND Corporation, Southern California Evidence-based Practice Center, Santa Monica, California.
Disclaimer: The findings and conclusions in this article are those of the authors, who are responsible for its contents. The findings and conclusions do not necessarily represent the views of the U.S. Department of Veterans Affairs or the U.S. government; therefore, no statement in this article should be construed as an official position of the U.S. Department of Veterans Affairs.
Acknowledgment: The authors thank David Atkins, Charles Anderson, Hardeep Singh, and David Douglas for their input as technical experts or operational partners for this report.
Grant Support: By the Veterans Affairs Quality Enhancement Research Initiative (Veterans Affairs Evidence Synthesis Program Project 05-226).
Corresponding Author: Caroline Lubick Goldzweig, MD, MS, Veterans Affairs West Los Angeles Healthcare Center, 11301 Wilshire Boulevard, 111-G, Los Angeles, CA 90073; e-mail, [email protected].
Current Author Addresses: Drs. Goldzweig, Orshansky, Paige, and Shekelle; Ms. Miake-Lye; and Ms. Beroes: Veterans Affairs West Los Angeles Healthcare Center, 11301 Wilshire Boulevard, 111-G, Los Angeles, CA 90073.
Ms. Ewing: RAND Corporation, 1776 Main Street, Santa Monica, CA 90401.
Author Contributions: Conception and design: C.L. Goldzweig, P.G. Shekelle.
Analysis and interpretation of the data: C.L. Goldzweig, G. Orshansky, N.M. Paige, B.A. Ewing, P.G. Shekelle.
Drafting of the article: C.L. Goldzweig, G. Orshansky, N.M. Paige, I.M. Miake-Lye, P.G. Shekelle.
Critical revision of the article for important intellectual content: G. Orshansky, N.M. Paige, I.M. Miake-Lye, C.L. Goldzweig, P.G. Shekelle.
Final approval of the article: C.L. Goldzweig, G. Orshansky, N.M. Paige, I.M. Miake-Lye, J.M. Beroes, B.A. Ewing, P.G. Shekelle.
Statistical expertise: B.A. Ewing.
Obtaining of funding: P.G. Shekelle.
Administrative, technical, or logistic support: I.M. Miake-Lye, J.M. Beroes.
Collection and assembly of data: C.L. Goldzweig, G. Orshansky, N.M. Paige, I.M. Miake-Lye, J.M. Beroes, B.A. Ewing, P.G. Shekelle.

Metrics & Citations

Metrics

Citations

If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. For an editable text file, please select Medlars format which will download as a .txt file. Simply select your manager software from the list below and click Download.

For more information or tips please see 'Downloading to a citation manager' in the Help menu.

Format





Download article citation data for:
Caroline Lubick Goldzweig, Greg Orshansky, Neil M. Paige, et al. Electronic Health Record–Based Interventions for Improving Appropriate Diagnostic Imaging: A Systematic Review and Meta-analysis. Ann Intern Med.2015;162:557-565. [Epub 21 April 2015]. doi:10.7326/M14-2600

View More

Get Access

Login Options:
Purchase

You will be redirected to acponline.org to sign-in to Annals to complete your purchase.

Create your Free Account

You will be redirected to acponline.org to create an account that will provide access to Annals.

View options

PDF/ePub

View PDF/ePub

Related in ACP Journals

Full Text

View Full Text

Media

Figures

Other

Tables

Share

Share

Copy the content Link

Share on social media