Mobilizing research evidence for daily decision-making is challenging for health system decision-makers. In a previous qualitative paper, we showed the current mix of supports that Canadian health-care organizations have in place and the ones that are perceived to be helpful to facilitate the use of research evidence in health system decision-making. Factors influencing the implementation of such supports remain poorly described in the literature. Identifying the barriers to and facilitators of different interventions is essential for implementation of effective, context-specific, supports for evidence-informed decision-making (EIDM) in health systems. The purpose of this study was to identify (a) barriers and facilitators to implementing supports for EIDM in Canadian health-care organizations, (b) views about emerging development of supports for EIDM, and (c) views about the priorities to bridge the gaps in the current mix of supports that these organizations have in place.
This qualitative study was conducted in three types of health-care organizations (regional health authorities, hospitals, and primary care practices) in two Canadian provinces (Ontario and Quebec). Fifty-seven in-depth semi-structured telephone interviews were conducted with senior managers, library managers, and knowledge brokers from health-care organizations that have already undertaken strategic initiatives in knowledge translation. The interviews were taped, transcribed, and then analyzed thematically using NVivo 9 qualitative data analysis software.
Limited resources (i.e., money or staff), time constraints, and negative attitudes (or resistance) toward change were the most frequently identified barriers to implementing supports for EIDM. Genuine interest from health system decision-makers, notably their willingness to invest money and resources and to create a knowledge translation culture over time in health-care organizations, was the most frequently identified facilitator to implementing supports for EIDM. The most frequently cited views about emerging development of supports for EIDM were implementing accessible and efficient systems to support the use of research in decision-making (e.g., documentation and reporting tools, communication tools, and decision support tools) and developing and implementing an infrastructure or position where the accountability for encouraging knowledge use lies. The most frequently stated priorities for bridging the gaps in the current mix of supports that these organizations have in place were implementing technical infrastructures to support research use and to ensure access to research evidence and establishing formal or informal ties to researchers and knowledge brokers outside the organization who can assist in EIDM.
These results provide insights on the type of practical implementation imperatives involved in supporting EIDM.
Evidence informed decision-making; Knowledge transfer and exchange; Knowledge translation
This protocol builds on the development of a) a framework that identified the various supports (i.e. positions, activities, interventions) that a healthcare organisation or health system can implement for evidence-informed decision-making (EIDM) and b) a qualitative study that showed the current mix of supports that some Canadian healthcare organisations have in place and the ones that are perceived to facilitate the use of research evidence in decision-making. Based on these findings, we developed a web survey to collect cross-sectional data about the specific supports that regional health authorities and hospitals in two Canadian provinces (Ontario and Quebec) have in place to facilitate EIDM.
This paper describes the methods for a cross-sectional web survey among 32 regional health authorities and 253 hospitals in the provinces of Quebec and Ontario (Canada) to collect data on the current mix of organisational supports that these organisations have in place to facilitate evidence-informed decision-making. The data will be obtained through a two-step survey design: a 10-min survey among CEOs to identify key units and individuals in regard to our objectives (step 1) and a 20-min survey among managers of the key units identified in step 1 to collect information about the activities performed by their unit regarding the acquisition, assessment, adaptation and/or dissemination of research evidence in decision-making (step 2). The study will target three types of informants: CEOs, library/documentation centre managers and all other key managers whose unit is involved in the acquisition, assessment, adaptation/packaging and/or dissemination of research evidence in decision-making. We developed an innovative data collection system to increase the likelihood that only the best-informed respondent available answers each survey question. The reporting of the results will be done using descriptive statistics of supports by organisation type and by province.
This study will be the first to collect and report large-scale cross-sectional data on the current mix of supports health system organisations in the two most populous Canadian provinces have in place for evidence-informed decision-making. The study will also provide useful information to researchers on how to collect organisation-level data with reduced risk of self-reporting bias.
Health systems; Knowledge translation; Research evidence; Cross-sectional study
One of the greatest challenges in healthcare is how to best translate research evidence into clinical practice, which includes how to change health-care professionals’ behaviours. A commonly held view is that multifaceted interventions are more effective than single-component interventions. The purpose of this study was to conduct an overview of systematic reviews to evaluate the effectiveness of multifaceted interventions in comparison to single-component interventions in changing health-care professionals’ behaviour in clinical settings.
The Rx for Change database, which consists of quality-appraised systematic reviews of interventions to change health-care professional behaviour, was used to identify systematic reviews for the overview. Dual, independent screening and data extraction was conducted. Included reviews used three different approaches (of varying methodological robustness) to evaluate the effectiveness of multifaceted interventions: (1) effect size/dose-response statistical analyses, (2) direct (non-statistical) comparisons of multifaceted to single interventions and (3) indirect comparisons of multifaceted to single interventions.
Twenty-five reviews were included in the overview. Three reviews provided effect size/dose-response statistical analyses of the effectiveness of multifaceted interventions; no statistical evidence of a relationship between the number of intervention components and the effect size was found. Eight reviews reported direct (non-statistical) comparisons of multifaceted to single-component interventions; four of these reviews found multifaceted interventions to be generally effective compared to single interventions, while the remaining four reviews found that multifaceted interventions had either mixed effects or were generally ineffective compared to single interventions. Twenty-three reviews indirectly compared the effectiveness of multifaceted to single interventions; nine of which also reported either a statistical (dose-response) analysis (N = 2) or a non-statistical direct comparison (N = 7). The majority (N = 15) of reviews reporting indirect comparisons of multifaceted to single interventions showed similar effectiveness for multifaceted and single interventions when compared to controls. Of the remaining eight reviews, six found single interventions to be generally effective while multifaceted had mixed effectiveness.
This overview of systematic reviews offers no compelling evidence that multifaceted interventions are more effective than single-component interventions.
Electronic supplementary material
The online version of this article (doi:10.1186/s13012-014-0152-6) contains supplementary material, which is available to authorized users.
Theory-based process evaluations conducted alongside randomized controlled trials provide the opportunity to investigate hypothesized mechanisms of action of interventions, helping to build a cumulative knowledge base and to inform the interpretation of individual trial outcomes. Our objective was to identify the underlying causal mechanisms in a cluster randomized trial of the effectiveness of printed educational materials (PEMs) to increase referral for diabetic retinopathy screening. We hypothesized that the PEMs would increase physicians’ intention to refer patients for retinal screening by strengthening their attitude and subjective norm, but not their perceived behavioral control.
Design: A theory based process evaluation alongside the Ontario Printed Educational Material (OPEM) cluster randomized trial. Postal surveys based on the Theory of Planned Behavior were sent to a random sample of trial participants two months before and six months after they received the intervention. Setting: Family physicians in Ontario, Canada. Participants: 1,512 family physicians (252 per intervention group) from the OPEM trial were invited to participate, and 31.3% (473/1512) responded at time one and time two. The final sample comprised 437 family physicians fully completing questionnaires at both time points. Main outcome measures: Primary: behavioral intention related to referring patient for retinopathy screening; secondary: attitude, subjective norm, perceived behavioral control.
At baseline, family physicians reported positive intention, attitude, subjective norm, and perceived behavioral control to advise patients about retinopathy screening suggesting limited opportunities for improvement in these constructs. There were no significant differences on intention, attitude, subjective norm, and perceived behavioral control following the intervention. Respondents also reported additional physician- and patient-related factors perceived to influence whether patients received retinopathy screening.
Lack of change in the primary and secondary theory-based outcomes provides an explanation for the lack of observed effect of the main OPEM trial. High baseline levels of intention to advise patients to attend retinopathy screening suggest that post-intentional and other factors may explain gaps in care. Process evaluations based on behavioral theory can provide replicable and generalizable insights to aid interpretation of randomized controlled trials of complex interventions to change health professional behavior.
Electronic supplementary material
The online version of this article (doi:10.1186/1748-5908-9-86) contains supplementary material, which is available to authorized users.
Process evaluation; Theory of planned behavior; Printed educational material; Healthcare professional behavior; Behavior change
Evidence of the effectiveness of printed educational messages in narrowing the gap between guideline recommendations and practice is contradictory. Failure to screen for retinopathy exposes primary care patients with diabetes to risk of eye complications. Screening is initiated by referral from family practitioners but adherence to guidelines is suboptimal. We aimed to evaluate the ability of printed educational messages aimed at family doctors to increase retinal screening of primary care patients with diabetes.
Design: Pragmatic 2×3 factorial cluster trial randomized by physician practice, involving 5,048 general practitioners (with 179,833 patients with diabetes). Setting: Ontario family practitioners. Interventions: Reminders (that retinal screening helps prevent diabetes-related vision loss and is covered by provincial health insurance for patients with diabetes) with prompts to encourage screening were mailed to each physician in conjunction with a widely-read professional newsletter. Alternative printed materials formats were an ‘outsert’ (short, directive message stapled to the outside of the newsletter), and/or a two-page, evidence-based article (‘insert’) and a pre-printed sticky note reminder for patients. Main outcome measure: A successful outcome was an eye examination (which includes retinal screening) provided to a patient with diabetes, not screened in the previous 12 months, within 90 days after visiting a family practitioner. Analysis accounted for clustering of doctors within practice groups.
No intervention effect was detected (eye exam rates were 31.6% for patients of control physicians, 31.3% for the insert, 32.8% for the outsert, 32.3% for those who received both, and 31.2% for those who received both plus the patient reminder with the largest 95% confidence interval around any effect extending from −1.3% to 1.1%).
This large trial conclusively failed to demonstrate any impact of printed educational messages on screening uptake. Despite their low cost, printed educational messages should not be routinely used in attempting to close evidence-practice gaps relating to diabetic retinopathy screening.
Electronic supplementary material
The online version of this article (doi:10.1186/1748-5908-9-87) contains supplementary material, which is available to authorized users.
Audits of blood transfusion demonstrate around 20% transfusions are outside national recommendations and guidelines. Audit and feedback is a widely used quality improvement intervention but effects on clinical practice are variable, suggesting potential for enhancement. Behavioural theory, theoretical frameworks of behaviour change and behaviour change techniques provide systematic processes to enhance intervention. This study is part of a larger programme of work to promote the uptake of evidence-based transfusion practice.
The objectives of this study are to design two theoretically enhanced audit and feedback interventions; one focused on content and one on delivery, and investigate the feasibility and acceptability.
Study A (Content): A coding framework based on current evidence regarding audit and feedback, and behaviour change theory and frameworks will be developed and applied as part of a structured content analysis to specify the key components of existing feedback documents. Prototype feedback documents with enhanced content and also a protocol, describing principles for enhancing feedback content, will be developed. Study B (Delivery): Individual semi-structured interviews with healthcare professionals and observations of team meetings in four hospitals will be used to specify, and identify views about, current audit and feedback practice. Interviews will be based on a topic guide developed using the Theoretical Domains Framework and the Consolidated Framework for Implementation Research. Analysis of transcripts based on these frameworks will form the evidence base for developing a protocol describing an enhanced intervention that focuses on feedback delivery. Study C (Feasibility and Acceptability): Enhanced interventions will be piloted in four hospitals. Semi-structured interviews, questionnaires and observations will be used to assess feasibility and acceptability.
This intervention development work reflects the UK Medical Research Council’s guidance on development of complex interventions, which emphasises the importance of a robust theoretical basis for intervention design and recommends systematic assessment of feasibility and acceptability prior to taking interventions to evaluation in a full-scale randomised study. The work-up includes specification of current practice so that, in the trials to be conducted later in this programme, there will be a clear distinction between the control (usual practice) conditions and the interventions to be evaluated.
Electronic supplementary material
The online version of this article (doi:10.1186/s13012-014-0092-1) contains supplementary material, which is available to authorized users.
Audit and feedback; Blood transfusion; Implementation; Health services research; Study protocol; Health professional behaviour change
A shortage of transplantable organs is a global problem. There are two types of organ donation: living and deceased. Deceased organ donation can occur following neurological determination of death (NDD) or cardiocirculatory death. Donation after cardiocirculatory death (DCD) accounts for the largest increments in deceased organ donation worldwide. Variations in the use of DCD exist, however, within Canada and worldwide. Reasons for these discrepancies are largely unknown. The purpose of this study is to develop, implement, and evaluate a theory-based knowledge translation intervention to provide practical guidance about how to increase the numbers of DCD organ donors without reducing the numbers of standard NDD donors.
We will use a mixed method three-step approach. In step one, we will conduct semi-structured interviews, informed by the Theoretical Domains Framework, to identify and describe stakeholders’ beliefs and attitudes about DCD and their perceptions of the multi-level factors that influence DCD. We will identify: determinants of the evidence-practice gap; specific behavioural changes and/or process changes needed to increase DCD; specific group(s) of clinicians or organizations (e.g., provincial donor organizations) in need of behaviour change; and specific targets for interventions. In step two, using the principles of intervention mapping, we will develop a theory-based knowledge translation intervention that encompasses behavior change techniques to overcome the identified barriers and enhance the enablers to DCD. In step three, we will roll out the intervention in hospitals across the 10 Canadian provinces and evaluate its effectiveness using a multiple interrupted time series design.
We will adopt a behavioural approach to define and test novel, theory-based, and ethically-acceptable knowledge translation strategies to increase the numbers of available DCD organ donors in Canada. If successful, this study will ultimately lead to more transplantations, reducing patient morbidity and mortality at a population-level.
An interrupted time series design is a powerful quasi-experimental approach for evaluating effects of interventions introduced at a specific point in time. To utilize the strength of this design, a modification to standard regression analysis, such as segmented regression, is required. In segmented regression analysis, the change in intercept and/or slope from pre- to post-intervention is estimated and used to test causal hypotheses about the intervention. We illustrate segmented regression using data from a previously published study that evaluated the effectiveness of a collaborative intervention to improve quality in pre-hospital ambulance care for acute myocardial infarction (AMI) and stroke. In the original analysis, a standard regression model was used with time as a continuous variable. We contrast the results from this standard regression analysis with those from segmented regression analysis. We discuss the limitations of the former and advantages of the latter, as well as the challenges of using segmented regression in analysing complex quality improvement interventions.
Based on the estimated change in intercept and slope from pre- to post-intervention using segmented regression, we found insufficient evidence of a statistically significant effect on quality of care for stroke, although potential clinically important effects for AMI cannot be ruled out.
Segmented regression analysis is the recommended approach for analysing data from an interrupted time series study. Several modifications to the basic segmented regression analysis approach are available to deal with challenges arising in the evaluation of complex quality improvement interventions.
Interrupted time series design; Segmented regression analysis; Quality improvement collaborative
New clinical research findings may require clinicians to change their behaviour to provide high-quality care to people with type 2 diabetes, likely requiring them to change multiple different clinical behaviours. The present study builds on findings from a UK-wide study of theory-based behavioural and organisational factors associated with prescribing, advising, and examining consistent with high-quality diabetes care.
To develop and evaluate the effectiveness and cost of an intervention to improve multiple behaviours in clinicians involved in delivering high-quality care for type 2 diabetes.
We will conduct a two-armed cluster randomised controlled trial in 44 general practices in the North East of England to evaluate a theory-based behaviour change intervention. We will target improvement in six underperformed clinical behaviours highlighted in quality standards for type 2 diabetes: prescribing for hypertension; prescribing for glycaemic control; providing physical activity advice; providing nutrition advice; providing on-going education; and ensuring that feet have been examined. The primary outcome will be the proportion of patients appropriately prescribed and examined (using anonymised computer records), and advised (using anonymous patient surveys) at 12 months. We will use behaviour change techniques targeting motivational, volitional, and impulsive factors that we have previously demonstrated to be predictive of multiple health professional behaviours involved in high-quality type 2 diabetes care. We will also investigate whether the intervention was delivered as designed (fidelity) by coding audiotaped workshops and interventionist delivery reports, and operated as hypothesised (process evaluation) by analysing responses to theory-based postal questionnaires. In addition, we will conduct post-trial qualitative interviews with practice teams to further inform the process evaluation, and a post-trial economic analysis to estimate the costs of the intervention and cost of service use.
Consistent with UK Medical Research Council guidance and building on previous development research, this pragmatic cluster randomised trial will evaluate the effectiveness of a theory-based complex intervention focusing on changing multiple clinical behaviours to improve quality of diabetes care.
Audit and feedback interventions in healthcare have been found to be effective, but there has been little progress with respect to understanding their mechanisms of action or identifying their key ‘active ingredients.’
Given the increasing use of audit and feedback to improve quality of care, it is imperative to focus further research on understanding how and when it works best. In this paper, we argue that continuing the ‘business as usual’ approach to evaluating two-arm trials of audit and feedback interventions against usual care for common problems and settings is unlikely to contribute new generalizable findings. Future audit and feedback trials should incorporate evidence- and theory-based best practices, and address known gaps in the literature.
We offer an agenda for high-priority research topics for implementation researchers that focuses on reviewing best practices for designing audit and feedback interventions to optimize effectiveness.
Audit and feedback; Synthesis; Best practice; Implementation; Optimization
Audit and feedback to physicians is a commonly used quality improvement strategy, but its optimal design is unknown. This trial tested the effects of a theory-informed worksheet to facilitate goal setting and action planning, appended to feedback reports on chronic disease management, compared to feedback reports provided without these worksheets.
A two-arm pragmatic cluster randomized trial was conducted, with allocation at the level of primary care clinics. Participants were family physicians who contributed data from their electronic medical records. The ‘usual feedback’ arm received feedback every six months for two years regarding the proportion of their patients meeting quality targets for diabetes and/or ischemic heart disease. The intervention arm received these same reports plus a worksheet designed to facilitate goal setting and action plan development in response to the feedback reports. Blood pressure (BP) and low-density lipoprotein cholesterol (LDL) values were compared after two years as the primary outcomes. Process outcomes measured the proportion of guideline-recommended actions (e.g., testing and prescribing) conducted within the appropriate timeframe. Intention-to-treat analysis was performed.
Outcomes were similar across groups at baseline. Final analysis included 20 physicians from seven clinics and 1,832 patients in the intervention arm (15% loss to follow up) and 29 physicians from seven clinics and 2,223 patients in the usual feedback arm (10% loss to follow up). Ten of 20 physicians completed the worksheet at least once during the study. Mean BP was 128/72 in the feedback plus worksheet arm and 128/73 in the feedback alone arm, while LDL was 2.1 and 2.0, respectively. Thus, no significant differences were observed across groups in the primary outcomes, but mean haemoglobin A1c was lower in the feedback plus worksheet arm (7.2% versus 7.4%, p<0.001). Improvements in both arms were noted over time for one-half of the process outcomes.
Appending a theory-informed goal setting and action planning worksheet to an externally produced audit and feedback intervention did not lead to improvements in patient outcomes. The results may be explained in part by passive dissemination of the worksheet leading to inadequate engagement with the intervention.
Dementia is a common and complex condition. Evidence-based guidelines for the management of people with dementia in general practice exist; however, detection, diagnosis and disclosure of dementia have been identified as potential evidence-practice gaps. Interventions to implement guidelines into practice have had varying success. The use of theory in designing implementation interventions has been limited, but is advocated because of its potential to yield more effective interventions and aid understanding of factors modifying the magnitude of intervention effects across trials. This protocol describes methods of a randomised trial that tests a theory-informed implementation intervention that, if effective, may provide benefits for patients with dementia and their carers.
This trial aims to estimate the effectiveness of a theory-informed intervention to increase GPs’ (in Victoria, Australia) adherence to a clinical guideline for the detection, diagnosis, and management of dementia in general practice, compared with providing GPs with a printed copy of the guideline. Primary objectives include testing if the intervention is effective in increasing the percentage of patients with suspected cognitive impairment who receive care consistent with two key guideline recommendations: receipt of a i) formal cognitive assessment, and ii) depression assessment using a validated scale (primary outcomes for the trial).
The design is a parallel cluster randomised trial, with clusters being general practices. We aim to recruit 60 practices per group. Practices will be randomised to the intervention and control groups using restricted randomisation. Patients meeting the inclusion criteria, and GPs’ detection and diagnosis behaviours directed toward these patients, will be identified and measured via an electronic search of the medical records nine months after the start of the intervention. Practitioners in the control group will receive a printed copy of the guideline. In addition to receipt of the printed guideline, practitioners in the intervention group will be invited to participate in an interactive, opinion leader-led, educational face-to-face workshop. The theory-informed intervention aims to address identified barriers to and enablers of implementation of recommendations. Researchers responsible for identifying the cohort of patients with suspected cognitive impairment, and their detection and diagnosis outcomes, will be blind to group allocation.
Australian New Zealand Clinical Trials Registry: ACTRN12611001032943 (date registered 28 September, 2011).
Decisions regarding health systems are sometimes made without the input of timely and reliable evidence, leading to less than optimal health outcomes. Healthcare organizations can implement tools and infrastructures to support the use of research evidence to inform decision-making.
The purpose of this study was to profile the supports and instruments (i.e., programs, interventions, instruments or tools) that healthcare organizations currently have in place and which ones were perceived to facilitate evidence-informed decision-making.
In-depth semi-structured telephone interviews were conducted with individuals in three different types of positions (i.e., a senior management team member, a library manager, and a ‘knowledge broker’) in three types of healthcare organizations (i.e., regional health authorities, hospitals and primary care practices) in two Canadian provinces (i.e., Ontario and Quebec). The interviews were taped, transcribed, and then analyzed thematically using NVivo 9 qualitative data analysis software.
A total of 57 interviews were conducted in 25 organizations in Ontario and Quebec. The main findings suggest that, for the healthcare organizations that participated in this study, the following supports facilitate evidence-informed decision-making: facilitating roles that actively promote research use within the organization; establishing ties to researchers and opinion leaders outside the organization; a technical infrastructure that provides access to research evidence, such as databases; and provision and participation in training programs to enhance staff’s capacity building.
This study identified the need for having a receptive climate, which laid the foundation for the implementation of other tangible initiatives and supported the use of research in decision-making. This study adds to the literature on organizational efforts that can increase the use of research evidence in decision-making. Some of the identified supports may increase the use of research evidence by decision-makers, which may then lead to more informed decisions, and hopefully to a strengthened health system and improved health.
The Canadian CT Head Rule was prospectively derived and validated to assist clinicians with diagnostic decision-making regarding the use of computed tomography (CT) in adult patients with minor head injury. A recent intervention trial failed to demonstrate a decrease in the rate of head CTs following implementation of the rule in Canadian emergency departments. Yet, the same intervention, which included a one-hour educational session and reminders at the point of requisition, was successful in reducing cervical spine imaging rates in the same emergency departments. The reason for the varied effect of the intervention across these two behaviours is unclear. There is an increasing appreciation for the use of theory to conduct process evaluations to better understand how strategies are linked with outcomes in implementation trials. The Theoretical Domains Framework (TDF) has been used to explore health professional behaviour and to design behaviour change interventions but, to date, has not been used to guide a theory-based process evaluation. In this proof of concept study, we explored whether the TDF could be used to guide a retrospective process evaluation to better understand emergency physicians’ responses to the interventions employed in the Canadian CT Head Rule trial.
A semi-structured interview guide, based on the 12 domains from the TDF, was used to conduct telephone interviews with project leads and physician participants from the intervention sites in the Canadian CT Head Rule trial. Two reviewers independently coded the anonymised interview transcripts using the TDF as a coding framework. Relevant domains were identified by: the presence of conflicting beliefs within a domain; the frequency of beliefs; and the likely strength of the impact of a belief on the behaviour.
Eight physicians from four of the intervention sites in the Canadian CT Head Rule trial participated in the interviews. Barriers likely to assist with understanding physicians’ responses to the intervention in the trial were identified in six of the theoretical domains: beliefs about consequences; beliefs about capabilities; behavioural regulation; memory, attention and decision processes; environmental context and resources; and social influences. Despite knowledge that the Canadian CT Head Rule was highly sensitive and reliable for identifying clinically important brain injuries and strong beliefs about the benefits for using the rule, a number of barriers were identified that may have prevented physicians from consistently applying the rule.
This proof of concept study demonstrates the use of the TDF as a guiding framework to design a retrospective theory-based process evaluation. There is a need for further development and testing of methods for using the TDF to guide theory-based process evaluations running alongside behaviour change intervention trials.
Healthcare-associated infections affect 10% of patients in Canadian acute-care hospitals and are significant and preventable causes of morbidity and mortality among hospitalized patients. Hand hygiene is among the simplest and most effective preventive measures to reduce these infections. However, compliance with hand hygiene among healthcare workers, specifically among physicians, is consistently suboptimal. We aim to first identify the barriers and enablers to physician hand hygiene compliance, and then to develop and pilot a theory-based knowledge translation intervention to increase physicians’ compliance with best hand hygiene practice.
The study consists of three phases. In Phase 1, we will identify barriers and enablers to hand hygiene compliance by physicians. This will include: key informant interviews with physicians and residents using a structured interview guide, informed by the Theoretical Domains Framework; nonparticipant observation of physician/resident hand hygiene audit sessions; and focus groups with hand hygiene experts. In Phase 2, we will conduct intervention mapping to develop a theory-based knowledge translation intervention to improve physician hand hygiene compliance. Finally, in Phase 3, we will pilot the knowledge translation intervention in four patient care units.
In this study, we will use a behavioural theory approach to obtain a better understanding of the barriers and enablers to physician hand hygiene compliance. This will provide a comprehensive framework on which to develop knowledge translation interventions that may be more successful in improving hand hygiene practice. Upon completion of this study, we will refine the piloted knowledge translation intervention so it can be tested in a multi-site cluster randomized controlled trial.
In the field of implementation research, there is an increased interest in use of theory when designing implementation research studies involving behavior change. In 2003, we initiated a series of five studies to establish a scientific rationale for interventions to translate research findings into clinical practice by exploring the performance of a number of different, commonly used, overlapping behavioral theories and models. We reflect on the strengths and weaknesses of the methods, the performance of the theories, and consider where these methods sit alongside the range of methods for studying healthcare professional behavior change.
These were five studies of the theory-based cognitions and clinical behaviors (taking dental radiographs, performing dental restorations, placing fissure sealants, managing upper respiratory tract infections without prescribing antibiotics, managing low back pain without ordering lumbar spine x-rays) of random samples of primary care dentists and physicians. Measures were derived for the explanatory theoretical constructs in the Theory of Planned Behavior (TPB), Social Cognitive Theory (SCT), and Illness Representations specified by the Common Sense Self Regulation Model (CSSRM). We constructed self-report measures of two constructs from Learning Theory (LT), a measure of Implementation Intentions (II), and the Precaution Adoption Process. We collected data on theory-based cognitions (explanatory measures) and two interim outcome measures (stated behavioral intention and simulated behavior) by postal questionnaire survey during the 12-month period to which objective measures of behavior (collected from routine administrative sources) were related. Planned analyses explored the predictive value of theories in explaining variance in intention, behavioral simulation and behavior.
Response rates across the five surveys ranged from 21% to 48%; we achieved the target sample size for three of the five surveys. For the predictor variables, the mean construct scores were above the mid-point on the scale with median values across the five behaviors generally being above four out of seven and the range being from 1.53 to 6.01. Across all of the theories, the highest proportion of the variance explained was always for intention and the lowest was for behavior. The Knowledge-Attitudes-Behavior Model performed poorly across all behaviors and dependent variables; CSSRM also performed poorly. For TPB, SCT, II, and LT across the five behaviors, we predicted median R2 of 25% to 42.6% for intention, 6.2% to 16% for behavioral simulation, and 2.4% to 6.3% for behavior.
We operationalized multiple theories measuring across five behaviors. Continuing challenges that emerge from our work are: better specification of behaviors, better operationalization of theories; how best to appropriately extend the range of theories; further assessment of the value of theories in different settings and groups; exploring the implications of these methods for the management of chronic diseases; and moving to experimental designs to allow an understanding of behavior change.
Evidence of variations in red blood cell transfusion practices have been reported in a wide range of clinical settings. Parallel studies in Canada and the United Kingdom were designed to explore transfusion behaviour in intensive care physicians. The aim of this paper is three-fold: first, to explore beliefs that influence Canadian intensive care physicians’ transfusion behaviour; second, to systematically select relevant theories and models using the Theoretical Domains Framework (TDF) to inform a future predictive study; and third, to compare its results with the UK study.
Ten intensive care unit (ICU) physicians throughout Canada were interviewed. Physicians’ responses were coded into theoretical domains, and specific beliefs were generated for each response. Theoretical domains relevant to behaviour change were identified, and specific constructs from the relevant domains were used to select psychological theories. The results from Canada and the United Kingdom were compared.
Seven theoretical domains populated by 31 specific beliefs were identified as relevant to the target behaviour. The domains Beliefs about capabilities (confident to not transfuse if patients’ clinical condition is stable), Beliefs about consequences (positive beliefs of reducing infection and saving resources and negative beliefs about risking patients’ clinical outcome and potentially more work), Social influences (transfusion decision is influenced by team members and patients’ relatives), and Behavioural regulation (wide range of approaches to encourage restrictive transfusion) that were identified in the UK study were also relevant in the Canadian context. Three additional domains, Knowledge (it requires more evidence to support restrictive transfusion), Social/professional role and identity (conflicting beliefs about not adhering to guidelines, referring to evidence, believing restrictive transfusion as professional standard, and believing that guideline is important for other professionals), and Motivation and goals (opposing beliefs about the importance of restrictive transfusion and compatibility with other goals), were also identified in this study. Similar to the UK study, the Theory of Planned Behaviour, Social Cognitive Theory, Operant Learning Theory, Action Planning, and Knowledge-Attitude-Behaviour model were identified as potentially relevant theories and models for further study. Personal project analysis was added to the Canadian study to explore the Motivation and goals domain in further detail.
A wide range of beliefs was identified by the Canadian ICU physicians as likely to influence their transfusion behaviour. We were able to demonstrate similar though not identical results in a cross-country comparison. Designing targeted behaviour-change interventions based on unique beliefs identified by physicians from two countries are more likely to encourage restrictive transfusion in ICU physicians in respective countries. This needs to be tested in future prospective clinical trials.
The Theoretical Domains Framework (TDF) was developed to investigate determinants of specific clinical behaviors and inform the design of interventions to change professional behavior. This framework was used to explore the beliefs of chiropractors in an American Provider Network and two Canadian provinces about their adherence to evidence-based recommendations for spine radiography for uncomplicated back pain. The primary objective of the study was to identify chiropractors’ beliefs about managing uncomplicated back pain without x-rays and to explore barriers and facilitators to implementing evidence-based recommendations on lumbar spine x-rays. A secondary objective was to compare chiropractors in the United States and Canada on their beliefs regarding the use of spine x-rays.
Six focus groups exploring beliefs about managing back pain without x-rays were conducted with a purposive sample. The interview guide was based upon the TDF. Focus groups were digitally recorded, transcribed verbatim, and analyzed by two independent assessors using thematic content analysis based on the TDF.
Five domains were identified as likely relevant. Key beliefs within these domains included the following: conflicting comments about the potential consequences of not ordering x-rays (risk of missing a pathology, avoiding adverse treatment effects, risks of litigation, determining the treatment plan, and using x-ray-driven techniques contrasted with perceived benefits of minimizing patient radiation exposure and reducing costs; beliefs about consequences); beliefs regarding professional autonomy, professional credibility, lack of standardization, and agreement with guidelines widely varied ( social/professional role & identity); the influence of formal training, colleagues, and patients also appeared to be important factors ( social influences); conflicting comments regarding levels of confidence and comfort in managing patients without x-rays ( belief about capabilities); and guideline awareness and agreements ( knowledge).
Chiropractors’ use of diagnostic imaging appears to be influenced by a number of factors. Five key domains may be important considering the presence of conflicting beliefs, evidence of strong beliefs likely to impact the behavior of interest, and high frequency of beliefs. The results will inform the development of a theory-based survey to help identify potential targets for behavioral-change strategies.
Theoretical domains framework; Focus groups; Content analysis; Social/professional role and identity; Social influence; Chiropractors; Radiography; X-ray guidelines; Back pain
Clinical practice guidelines are one of the foundations of efforts to improve healthcare. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearinghouses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this second paper, we discuss issues of identifying and synthesizing evidence: deciding what type of evidence and outcomes to include in guidelines; integrating values into a guideline; incorporating economic considerations; synthesis, grading, and presentation of evidence; and moving from evidence to recommendations.
Clinical practice guidelines are one of the foundations of efforts to improve health care. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearing houses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this third paper we discuss the issues of: reviewing, reporting, and publishing guidelines; updating guidelines; and the two emerging issues of enhancing guideline implementability and how guideline developers should approach dealing with the issue of patients who will be the subject of guidelines having co-morbid conditions.
Clinical practice guidelines are one of the foundations of efforts to improve health care. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearing houses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this first paper we discuss: the target audience(s) for guidelines and their use of guidelines; identifying topics for guidelines; guideline group composition (including consumer involvement) and the processes by which guideline groups function and the important procedural issue of managing conflicts of interest in guideline development.
Routine pre-operative tests for anesthesia management are often ordered by both anesthesiologists and surgeons for healthy patients undergoing low-risk surgery. The Theoretical Domains Framework (TDF) was developed to investigate determinants of behaviour and identify potential behaviour change interventions. In this study, the TDF is used to explore anaesthesiologists’ and surgeons’ perceptions of ordering routine tests for healthy patients undergoing low-risk surgery.
Sixteen clinicians (eleven anesthesiologists and five surgeons) throughout Ontario were recruited. An interview guide based on the TDF was developed to identify beliefs about pre-operative testing practices. Content analysis of physicians’ statements into the relevant theoretical domains was performed. Specific beliefs were identified by grouping similar utterances of the interview participants. Relevant domains were identified by noting the frequencies of the beliefs reported, presence of conflicting beliefs, and perceived influence on the performance of the behaviour under investigation.
Seven of the twelve domains were identified as likely relevant to changing clinicians’ behaviour about pre-operative test ordering for anesthesia management. Key beliefs were identified within these domains including: conflicting comments about who was responsible for the test-ordering (Social/professional role and identity); inability to cancel tests ordered by fellow physicians (Beliefs about capabilities and social influences); and the problem with tests being completed before the anesthesiologists see the patient (Beliefs about capabilities and Environmental context and resources). Often, tests were ordered by an anesthesiologist based on who may be the attending anesthesiologist on the day of surgery while surgeons ordered tests they thought anesthesiologists may need (Social influences). There were also conflicting comments about the potential consequences associated with reducing testing, from negative (delay or cancel patients’ surgeries), to indifference (little or no change in patient outcomes), to positive (save money, avoid unnecessary investigations) (Beliefs about consequences). Further, while most agreed that they are motivated to reduce ordering unnecessary tests (Motivation and goals), there was still a report of a gap between their motivation and practice (Behavioural regulation).
We identified key factors that anesthesiologists and surgeons believe influence whether they order pre-operative tests routinely for anesthesia management for a healthy adults undergoing low-risk surgery. These beliefs identify potential individual, team, and organisation targets for behaviour change interventions to reduce unnecessary routine test ordering.
Routine pre-operative testing; Anesthesia management; Anesthesiologists; Surgeons; Chest x-rays; Electrocardiograms; Theoretical domains framework; Semi-structured interviews; Content analysis; Social; Professional role and identity; Social influence
Despite evidence-based recommendations supporting long-term use of cardiac medications in patients post ST-elevation myocardial infarction, adherence is known to decline over time. Discontinuation of cardiac medications in such patients is associated with increased mortality.
This is a pragmatic, cluster-randomized controlled trial with blinded outcome assessment and embedded qualitative process evaluation. Patients from one health region in Ontario, Canada who undergo a coronary angiogram during their admission for ST-elevation myocardial infarction and who survive their initial hospitalization will be included. Allocation of eligible patients to intervention or usual care will take place within one week after the angiogram using a computer-generated random sequence. To avoid treatment contamination, patients treated by the same family physician will be allocated to the same study arm. The intervention consists of recurrent, personalized, paper-based educational messages and reminders sent via post on behalf of the interventional cardiologist to the patient, family physician, and pharmacist urging long-term adherence to secondary prevention medications. The primary outcome is the proportion of patients who report in a phone interview taking all relevant classes of cardiac medications at twelve months. Secondary outcomes to be measured at three and twelve months include proportions of patients who report: actively taking each cardiac medication class of interest (item-by-item); stopping medications due to side effects; taking one or two or three medication classes concurrently; a perfect Morisky Medication Adherence Score for cardiac medication compliance; and having a discussion with their family physician about long-term adherence to cardiac medications. Self-reported measures of adherence will be validated using administrative data for prescriptions filled.
This intervention is designed to be easily generalizable. If effective, it could be implemented broadly. If it does not change medication utilization, the process evaluation will offer insights regarding how such an intervention could be optimized in future.
Randomized trial; Medication adherence; Reminders
One of the most consistent findings from clinical and health services research is the failure to translate research into practice and policy. As a result of these evidence-practice and policy gaps, patients fail to benefit optimally from advances in healthcare and are exposed to unnecessary risks of iatrogenic harms, and healthcare systems are exposed to unnecessary expenditure resulting in significant opportunity costs. Over the last decade, there has been increasing international policy and research attention on how to reduce the evidence-practice and policy gap. In this paper, we summarise the current concepts and evidence to guide knowledge translation activities, defined as T2 research (the translation of new clinical knowledge into improved health). We structure the article around five key questions: what should be transferred; to whom should research knowledge be transferred; by whom should research knowledge be transferred; how should research knowledge be transferred; and, with what effect should research knowledge be transferred?
We suggest that the basic unit of knowledge translation should usually be up-to-date systematic reviews or other syntheses of research findings. Knowledge translators need to identify the key messages for different target audiences and to fashion these in language and knowledge translation products that are easily assimilated by different audiences. The relative importance of knowledge translation to different target audiences will vary by the type of research and appropriate endpoints of knowledge translation may vary across different stakeholder groups. There are a large number of planned knowledge translation models, derived from different disciplinary, contextual (i.e., setting), and target audience viewpoints. Most of these suggest that planned knowledge translation for healthcare professionals and consumers is more likely to be successful if the choice of knowledge translation strategy is informed by an assessment of the likely barriers and facilitators. Although our evidence on the likely effectiveness of different strategies to overcome specific barriers remains incomplete, there is a range of informative systematic reviews of interventions aimed at healthcare professionals and consumers (i.e., patients, family members, and informal carers) and of factors important to research use by policy makers.
There is a substantial (if incomplete) evidence base to guide choice of knowledge translation activities targeting healthcare professionals and consumers. The evidence base on the effects of different knowledge translation approaches targeting healthcare policy makers and senior managers is much weaker but there are a profusion of innovative approaches that warrant further evaluation.
There is little systematic operational guidance about how best to develop complex interventions to reduce the gap between practice and evidence. This article is one in a Series of articles documenting the development and use of the Theoretical Domains Framework (TDF) to advance the science of implementation research.
The intervention was developed considering three main components: theory, evidence, and practical issues. We used a four-step approach, consisting of guiding questions, to direct the choice of the most appropriate components of an implementation intervention: Who needs to do what, differently? Using a theoretical framework, which barriers and enablers need to be addressed? Which intervention components (behaviour change techniques and mode(s) of delivery) could overcome the modifiable barriers and enhance the enablers? And how can behaviour change be measured and understood?
A complex implementation intervention was designed that aimed to improve acute low back pain management in primary care. We used the TDF to identify the barriers and enablers to the uptake of evidence into practice and to guide the choice of intervention components. These components were then combined into a cohesive intervention. The intervention was delivered via two facilitated interactive small group workshops. We also produced a DVD to distribute to all participants in the intervention group. We chose outcome measures in order to assess the mediating mechanisms of behaviour change.
We have illustrated a four-step systematic method for developing an intervention designed to change clinical practice based on a theoretical framework. The method of development provides a systematic framework that could be used by others developing complex implementation interventions. While this framework should be iteratively adjusted and refined to suit other contexts and settings, we believe that the four-step process should be maintained as the primary framework to guide researchers through a comprehensive intervention development process.