Our evaluation suggests any decision regarding the use of A-CVCs in ICU patients is uncertain. The findings from the first analysis, which do not consider uncertainty, concur with existing economic evidence [
6,
7]. This shows that, for all four types of antimicrobial catheter, health gains will be accompanied by cost savings. Given the assumption of a low attributable mortality and a low rate of infection, expected health gains are minimal and the decision is driven by the change in costs. Most of these costs represent the value of obtaining increased capacity within the ICU, rather than cash savings. Nevertheless, the results of the first analysis imply a decision not to adopt these catheters will harm patients by reducing their health status and increasing their risk of mortality and, simultaneously, waste resources within the healthcare system.
Our second analysis, using PSA, introduces the uncertainty associated with the decision. Based on current information, the MR catheters are the optimal decision because they return the highest net monetary benefits relative to all other catheter types. However, the probability of error in this conclusion is high, at 62%. Our third analysis shows that MR catheters remain the optimal decision across a range of scenarios and quantifies how uncertainty in this decision varies. Uncertainty is lower for scenarios where decision makers believe that attributable mortality is high, where they value bed days highly, or where the starting infection rate is high. This finding fits with conclusions from a recent meta-analysis that suggests that antimicrobial catheters will return a higher treatment benefit when infection rates are high [
40], and provides support for current guidelines which recommend reserving their use for settings with high infection rates [
9]. However, even in these scenarios the probability that this conclusion is wrong, and the MR catheters are not optimal, does not reduce below 46%.
Interpreting the results of cost effectiveness analyses under uncertainty requires decision makers to think beyond conventional error rates as used in statistical analysis. Decision makers looking to maximize health returns from their budget should choose between these catheters by selecting the option with the highest monetary net benefits. Given the current evidence, MR catheters should be chosen even if the probability of error in this conclusion exceeds the standard level of 5% used to define statistical significance. The justification is that a decision not to use them in favor of uncoated catheters would impose economic costs, arising from average monetary net benefits foregone, of AUD $948 per catheter [
41] (AUD $391,612 minus AUD $390,664). This conclusion should lead to rapid and sustained uptake of the technology [
5], yet their use appears to be limited despite earlier estimates of these catheters being cost effective [
6,
7]. We suggest that uncertainty over this cost effectiveness evidence may be partly responsible.
Studies have shown that decision makers are heavily influenced by uncertainty [
35,
42]. Presenting decision makers with an estimate of uncertainty in the results of an economic evaluation is important for the following reasons: it makes the current state of knowledge about the decision explicit and quantifies confidence (or lack of) in conclusions; it allows them to weigh the cost effectiveness results against other relevant considerations in the adoption decision including their own attitude to risk; and it provides an indication of the value of conducting further research to reduce uncertainty.
Two aspects to uncertainty are important: the probability of making the wrong choice and the potential consequences of getting it wrong. Both elements are required; a decision with a 5% probability of being wrong may still be perceived as uncertain if the consequences are very large. Decision makers tend to be risk averse. Rather than being focused solely on maximizing health returns, they are also concerned with interventions that have the potential to result in harmful outcomes. If there is no potential for harm then decision makers may be happy to accept a new intervention with a high but uncertain benefit. But where the potential for harm is perceived to be high, an existing intervention with a lower benefit may be preferred. Antimicrobial catheters are perceived to carry a risk of a number of negative outcomes that are likely to deter from their introduction, including the potential for a loss of focus on hygiene procedures. There has also been discussion [
43] that MR catheters may select for resistant organisms, with higher morbidity and costs [
44]. This negative could outweigh potential short-term benefits from these catheters [
45]. An absence of clear evidence [
46] makes it difficult to quantitatively incorporate this risk into an economic evaluation [
47] but it is an important consideration in the adoption decision.
Decision makers deciding whether to use antimicrobial catheters also have a second choice: whether to collect more information to reduce uncertainty in their choice [
48]. Value of information analysis [
41] can be used to estimate the expected monetary net benefits arising from collecting new information and compare this to the anticipated research costs to indicate whether the research is justifiable. It has been suggested further trials of antimicrobial catheters should be undertaken [
43]. Due to the relative rarity of infection these will require a large sample size and the involvement of multiple institutions [
43], making them an expensive proposition. Estimating the expected monetary net benefits from a trial would indicate if this is the best way to spend research dollars.
Some important sources of uncertainty have been explored in these analyses, but there are other uncertain elements in this decision that have not been explicitly examined. There is evidence the relative effectiveness of A-CVCs, as compared to uncoated catheters, varies according to duration of catheterization [
49] and causative organism [
50], and there have been reports of toxicity associated with use of particular types of catheter [
13]. However, a lack of data about these concerns both generally, and in relation to each specific coating, meant we were unable to model their impact. If these aspects reduce the effectiveness of any of the catheter types then its cost effectiveness would also be reduced. Alternatively there may be specific subgroups of patients for whom the cost effectiveness of these catheters can be determined with greater certainty. We did not test assumptions about life expectancy and quality of life in ICU survivors, although these will not alter conclusions about which catheter is optimal as all types will be affected equally.
This evaluation, like those reported in earlier studies, is based on a simplified version of a complex decision. It did not include intangible benefits to reduced infection rates, including the increases to clinical morale and public confidence in the healthcare system demonstrated by the national campaigns to reduce rates of CR-BSI [
2] and forming part of the rationale for the introduction of the Deficit Reduction Act [
4]. Decision makers often consider a wider range of outcomes when deciding on the adoption of a new technology [
35,
42] and clearly the economic value in reducing infection rates goes beyond the capacity released within hospitals. Valuing these intangible outcomes may improve the representation of the economics of preventing infection, but it would be difficult to achieve. It has been suggested that MR-coated catheters are difficult to insert [
6], making them unpopular amongst clinicians, but data comparing failure rates for insertion are not available in order to incorporate this cost. Finally, recent research has shown that improving catheter care by intervention 'bundles' is a highly effective way to reduce rates of CR-BSI [
51]. In an evaluation comparing 'bundles' with antimicrobial catheters, it may be that the former would dominate. This is not evaluated here and deserves rigorous exploration rather than hypothesizing.