PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of jcmPermissionsJournals.ASM.orgJournalJCM ArticleJournal InfoAuthorsReviewers
 
J Clin Microbiol. 2016 October; 54(10): 2420–2423.
Published online 2016 September 23. Prepublished online 2016 August 17. doi:  10.1128/JCM.01484-16
PMCID: PMC5035404

The Confounding Role of Antimicrobial Stewardship Programs in Understanding the Impact of Technology on Patient Care

C.-A. D. Burnham, Editor
Washington University School of Medicine

Abstract

Numerous studies have demonstrated the benefit of the combination of antimicrobial stewardship program (ASP) intervention and rapid diagnostic testing (RDT). However, few studies have attempted to study the incremental benefit of ASP and RDT, making it difficult to understand the true benefits of each intervention. This issue is discussed in the context of an article by S. H. McVane and F. S. Nolte (J Clin Microbiol 54:2476–2484, 2016, http://dx.doi.org/doi:10.1128/JCM.00996-16), with suggestions about how the findings of this study can be applied to other areas of clinical microbiology.

TEXT

The practice of clinical microbiology is classically broken down into three phases: the preanalytical phase, the analytical phase, and the postanalytical phase. The analytical phase of clinical microbiology testing has been so highly standardized that laboratories are able to produce reliable and reproducible results across the United States and around the world. While most resources are dedicated to analytical-phase quality, laboratories are generally less engaged in ensuring quality through the reporting and interpretation (postanalytical) phase. Beyond ensuring that information is communicated accurately for the medical record, little effort is devoted to confirming that that results are actually viewed, much less acted upon appropriately. There are a number of reasons why a clinical microbiology result might fail to have the desired impact on patient care; frequently, though, it is because a result either is not noticed or is misunderstood (1, 2).

At the heart of this issue is the fact that most medical results are communicated passively, through an electronic medical record reporting system. Although these systems are excellent for transmitting information rapidly and accurately, they are also problematic because they present overwhelming quantities of information to providers who may overlook critical results. In addition, the timely observation of microbiology results can be a significant challenge for providers. Unlike many other laboratory results (i.e., chemistry), the timing of microbiology reporting is difficult to predict, and it is therefore impossible for the provider to know when a result will be available in the medical record. This is a tremendous limitation in laboratory reporting and a significant confounder when laboratories implement new technology for improved patient care because, although results may be generated faster, providers may not see them any sooner, thus negating any benefit gained from the improved turnaround time.

Microbiologists are well aware of this limitation, and as a result, we stack the deck in our favor when implementing new diagnostics for the betterment of patient care. A review of studies evaluating the impact of rapid diagnostic testing (RDT) on patient outcomes reveals an important confounding variable: in nearly every case, active reporting was employed in combination with the addition of the new technology. Table 1 summarizes some of these studies and shows that in nearly all cases, the results of the new technology were actively communicated either to the provider directly or to an antimicrobial stewardship program (ASP). In many cases, those results were communicated together with some expert advice as to how they ought to be interpreted and used. This is likely the best way to improve patient care; however, scientifically, we are left to wonder what the true impact of the technology itself was.

TABLE 1
Summary of outcome-based studies evaluating the impact of rapid diagnostic testing and antimicrobial stewardship program intervention

Few studies have controlled for the variable of active reporting as it pertains to the implementation of new technology. With the addition of expensive technologies such as matrix-assisted laser desorption ionization–time of flight mass spectrometry (MALDI-TOF MS), rapid antimicrobial susceptibility testing (AST), and multiplex PCR, we want to believe that the expense of the added resources is justified by improved patient care. Indeed, some studies have demonstrated impressive improvement in care, both in terms of appropriate prescription of antibiotics and in terms of lengths of stay, mortality, and hospital costs (Table 1). However, other studies using much simpler technologies have shown similar improvements (15). For example, Doern et al. showed that the addition of “rapid” disk diffusion testing using positive blood cultures reduced patient mortality (15). Another interesting study showed that simply providing Gram stain results by telephone versus not phoning the results significantly reduced patient mortality (16). It is likely that the improved patient care demonstrated by these studies has more to do with the difference between the old and new diagnostic technologies than it does with the technology itself. Nonetheless, it is difficult to know whether it is the technology or the reporting mechanism that is responsible for improving patient outcomes.

MacVane and Nolte present the results of a unique study in which they evaluated the incremental impact of ASP as well as RDT testing on the care of patients with bloodstream infection (17). In their study, they controlled for active reporting by evaluating an ASP-only period, followed by a period where ASP and RDT were combined. In addition, they included a pre-ASP, pre-RDT control period, which allowed them to draw conclusions about the incremental impact of both ASP and the combination of ASP and RDT.

The most important and most striking finding from the study is that the ASP-plus-RDT period had a significantly reduced time to effective antibiotic therapy (4.9 h) versus both the ASP-only period and the preintervention control period (13 h and 15 h, respectively). In addition, they found no difference between the results from the ASP-only period and those from the preintervention period, which suggests that ASP had little impact on the time to effective antimicrobial therapy. This is an important finding because few studies have included the unique dual-control (no-ASP and ASP-only) study design which would allow this comparison. Most of the studies highlighted in Table 1 represent comparisons between ASP-only interventions and ASP-plus-RDT interventions. If an ASP-only control is not included, then the comparisons are made between a no-ASP control group and an ASP-plus-RDT intervention group. In either case, it is impossible to know the incremental impacts of ASP and RDT.

While the findings of MacVane and Nolte suggest that RDT played a more important role than ASP in reducing the time to effective antibiotic therapy, their analysis of antibiotic de-escalation clearly shows the importance of ASP. These data show that both the ASP-only and the ASP-plus-RDT periods led to de-escalation in 56.7% and 52.4% of cases within the first 96 h, compared with only 33.9% of patients in the no-ASP group. However, the average time to de-escalation was 12 h earlier in the ASP-plus-RDT group than in the ASP-only and the no-ASP groups.

The limitation of the study is that it lacked the RDT-only control period, leaving the reader with an unanswered question: what impact would RDTs have on patient care in the absence of ASP? To answer this question, we can look to the recent publication by Banerjee et al., who, like MacVane and Nolte, included a dual-control group in their study assessing the impact of RDT for positive blood cultures (14). However, their controls differed from those in the study by MacVane and Nolte because they included an RDT-only group rather than an ASP-only group. Interestingly, Banerjee et al. found that RDT-only interventions optimized antibiotic selection but that the addition of ASP to RDT enhanced the effect and had a particularly profound impact on antibiotic de-escalation (14). Taken together, the findings presented by MacVane and Nolte as well as Banerjee et al. suggest an additive relationship between RDT and ASP interventions. This conclusion is somewhat intuitive but one that had not been extensively tested in appropriately controlled studies. In summary, we learn from these studies that positive impacts on patient care are best driven by rapid and accurate diagnostic testing that is efficiently translated to patient intervention through integrated ASPs. Based on the overwhelmingly positive outcomes documented by MacVane and Nolte and the studies highlighted in Table 1, microbiologists and ASPs should be empowered by the knowledge that both play a vital role in improving patient care.

In reviewing the literature, it becomes obvious that most studies of ASP and RDT outcomes focus on improving care for those with bloodstream infection. While this is certainly an important patient population where subtle improvements can mean the difference between life and death, clinical microbiology laboratories seek to improve care for other patient populations where positive outcomes may be more difficult to document. The clinical microbiology community as a whole has invested tremendous resources in adopting newly developed diagnostic technologies, despite a paucity of evidence that they will have a positive impact on patient care. Examples include MALDI-TOF MS identification of organisms isolated from nonblood, clinical specimens; multiplex PCR testing for respiratory, central nervous system, and gastrointestinal pathogens; and many others. Despite the lack of outcome data supporting the use of these technologies, the clinical microbiology and infectious diseases (ID) communities have embraced their use without hesitation because of their superior analytical performance. But how do we justify the cost? Are patients really better off because a multiplex respiratory PCR provided a diagnosis of rhinovirus infection? And how do patients feel about paying over $1,000 for that diagnosis? The unfortunate reality is that we do not yet know whether patients benefit from these technologies. In the majority of cases, they probably do not. But that does not mean that they cannot.

Although most patients affected by new diagnostic technologies are not critically ill, there should be no doubt that their care would be improved by a more accurate and rapid diagnosis. And yet the clinical microbiology and ID community has failed to objectively demonstrate the benefit of such technologies. This reality prompted a recent editorial in the Journal of Clinical Microbiology outlining the need for more outcome-based studies documenting the value of our work (18). After all, if at the end of the day, our efforts, and the resources expended, do not result in better patient care, hospitals will utilize those resources elsewhere. And while the task of proving that we are improving patient care is daunting, the lessons learned from MacVane and Nolte can be used to stack the deck in our favor once again.

Most ASPs focus their efforts on the care of critically ill patients because these interventions have a high likelihood of improving outcomes. What if those same resources could be used to intervene in the care of patients other than those with bacteremia? A compelling argument could be made that no other resource would have a greater impact on patient care than a laboratory stewardship program designed to ensure optimal use of all laboratory results. Such a program should exist separately from, but work closely with, existing ASPs. It should operate under the direction of the clinical microbiology laboratory and focus its efforts on promoting the appropriate and timely utilization of laboratory results because, if we are serious about improving patient care, then we will learn from what MacVane and Nolte, Banerjee et al., and all of researchers who performed the studies listed in Table 1 have found, which is that better outcomes come not just from better diagnostics, and not just from better stewardship, but from the combination of the two.

Notes

The views expressed in this Commentary do not necessarily reflect the views of the journal or of ASM.

Footnotes

For the article discussed, see doi:10.1128/JCM.00996-16.

REFERENCES

1. Kilpatrick ES, Holding S 2001. Use of computer terminals on wards to access emergency test results: a retrospective audit. BMJ 322:1101–1103. doi:.10.1136/bmj.322.7294.1101 [PMC free article] [PubMed] [Cross Ref]
2. Callen JL, Westbrook JI, Georgiou A, Li J 2012. Failure to follow-up test results for ambulatory patients: a systematic review. J Gen Intern Med 27:1334–1348. doi:.10.1007/s11606-011-1949-5 [PMC free article] [PubMed] [Cross Ref]
3. Barenfanger J, Drake C, Kacich G 1999. Clinical and financial benefits of rapid bacterial identification and antimicrobial susceptibility testing. J Clin Microbiol 37:1415–1418. [PMC free article] [PubMed]
4. Trenholme GM, Kaplan RL, Karakusis PH, Stine T, Fuhrer J, Landau W, Levin S 1989. Clinical impact of rapid identification and susceptibility testing of bacterial blood culture isolates. J Clin Microbiol 27:1342–1345. [PMC free article] [PubMed]
5. Doern GV, Vautour R, Gaudet M, Levy B 1994. Clinical impact of rapid in vitro susceptibility testing and bacterial identification. J Clin Microbiol 32:1757–1762. [PMC free article] [PubMed]
6. Forrest GN, Roghmann MC, Toombs LS, Johnson JK, Weekes E, Lincalis DP, Venezia RA 2008. Peptide nucleic acid fluorescent in situ hybridization for hospital-acquired enterococcal bacteremia: delivering earlier effective antimicrobial therapy. Antimicrob Agents Chemother 52:3558–3563. doi:.10.1128/AAC.00283-08 [PMC free article] [PubMed] [Cross Ref]
7. Forrest GN, Mankes K, Jabra-Rizk MA, Weekes E, Johnson JK, Lincalis DP, Venezia RA 2006. Peptide nucleic acid fluorescence in situ hybridization-based identification of Candida albicans and its impact on mortality and antifungal therapy costs. J Clin Microbiol 44:3381–3383. doi:.10.1128/JCM.00751-06 [PMC free article] [PubMed] [Cross Ref]
8. Nagel JL, Huang AM, Kunapuli A, Gandhi TN, Washer LL, Lassiter J, Patel T, Newton DW 2014. Impact of antimicrobial stewardship intervention on coagulase-negative Staphylococcus blood cultures in conjunction with rapid diagnostic testing. J Clin Microbiol 52:2849–2854. doi:.10.1128/JCM.00682-14 [PMC free article] [PubMed] [Cross Ref]
9. Walker T, Dumadag S, Lee CJ, Lee SH, Bender JM, Cupo Abbott J, She RC 2016. Clinical impact of laboratory implementation of Verigene BC-GN microarray-based assay for detection of Gram-negative bacteria in positive blood cultures. J Clin Microbiol 54:1789–1796. doi:.10.1128/JCM.00376-16 [PMC free article] [PubMed] [Cross Ref]
10. Bauer KA, West JE, Balada-Llasat JM, Pancholi P, Stevenson KB, Goff DA 2010. An antimicrobial stewardship program's impact with rapid polymerase chain reaction methicillin-resistant Staphylococcus aureus/S. aureus blood culture test in patients with S. aureus bacteremia. Clin Infect Dis 51:1074–1080. doi:.10.1086/656623 [PubMed] [Cross Ref]
11. Perez KK, Olsen RJ, Musick WL, Cernoch PL, Davis JR, Peterson LE, Musser JM 2014. Integrating rapid diagnostics and antimicrobial stewardship improves outcomes in patients with antibiotic-resistant Gram-negative bacteremia. J Infect 69:216–225. doi:.10.1016/j.jinf.2014.05.005 [PubMed] [Cross Ref]
12. Sango A, McCarter YS, Johnson D, Ferreira J, Guzman N, Jankowski CA 2013. Stewardship approach for optimizing antimicrobial therapy through use of a rapid microarray assay on blood cultures positive for Enterococcus species. J Clin Microbiol 51:4008–4011. doi:.10.1128/JCM.01951-13 [PMC free article] [PubMed] [Cross Ref]
13. Perez KK, Olsen RJ, Musick WL, Cernoch PL, Davis JR, Land GA, Peterson LE, Musser JM 2013. Integrating rapid pathogen identification and antimicrobial stewardship significantly decreases hospital costs. Arch Pathol Lab Med 137:1247–1254. doi:.10.5858/arpa.2012-0651-OA [PubMed] [Cross Ref]
14. Banerjee R, Teng CB, Cunningham SA, Ihde SM, Steckelberg JM, Moriarty JP, Shah ND, Mandrekar JN, Patel R 2015. Randomized trial of rapid multiplex polymerase chain reaction-based blood culture identification and susceptibility testing. Clin Infect Dis 61:1071–1080. doi:.10.1093/cid/civ447 [PMC free article] [PubMed] [Cross Ref]
15. Doern GV, Scott DR, Rashad AL 1982. Clinical impact of rapid antimicrobial susceptibility testing of blood culture isolates. Antimicrob Agents Chemother 21:1023–1024. doi:.10.1128/AAC.21.6.1023 [PMC free article] [PubMed] [Cross Ref]
16. Barenfanger J, Graham DR, Kolluri L, Sangwan G, Lawhorn J, Drake CA, Verhulst SJ, Peterson R, Moja LB, Ertmoed MM, Moja AB, Shevlin DW, Vautrain R, Callahan CD 2008. Decreased mortality associated with prompt Gram staining of blood cultures. Am J Clin Pathol 130:870–876. doi:.10.1309/AJCPVMDQU2ZJDPBL [PubMed] [Cross Ref]
17. MacVane SH, Nolte FS 2016. Benefits of adding a rapid PCR-based blood culture identification panel to an established antimicrobial stewardship program. J Clin Microbiol 54:2476–2484. doi:.10.1128/JCM.00996-16 [PMC free article] [PubMed] [Cross Ref]
18. Doern GV. 2014. The value of outcomes data in the practice of clinical microbiology. J Clin Microbiol 52:1314–1316. doi:.10.1128/JCM.00712-14 [PMC free article] [PubMed] [Cross Ref]

Articles from Journal of Clinical Microbiology are provided here courtesy of American Society for Microbiology (ASM)