Providing patient-centered care requires that patients partner in their personal health-care decisions to the full extent desired. Patient decision aids facilitate processes of shared decision-making between patients and their clinicians by presenting relevant scientific information in balanced, understandable ways, helping clarify patients’ goals, and guiding decision-making processes. Although international standards stipulate that patients and clinicians should be involved in decision aid development, little is known about how such involvement currently occurs, let alone best practices. This systematic review consisting of three interlinked subreviews seeks to describe current practices of user involvement in the development of patient decision aids, compare these to practices of user-centered design, and identify promising strategies.
A research team that includes patient and clinician representatives, decision aid developers, and systematic review method experts will guide this review according to the Cochrane Handbook and PRISMA reporting guidelines. A medical librarian will hand search key references and use a peer-reviewed search strategy to search MEDLINE, EMBASE, PubMed, Web of Science, the Cochrane Library, the ACM library, IEEE Xplore, and Google Scholar. We will identify articles across all languages and years describing the development or evaluation of a patient decision aid, or the application of user-centered design or human-centered design to tools intended for patient use. Two independent reviewers will assess article eligibility and extract data into a matrix using a structured pilot-tested form based on a conceptual framework of user-centered design. We will synthesize evidence to describe how research teams have included users in their development process and compare these practices to user-centered design methods. If data permit, we will develop a measure of the user-centeredness of development processes and identify practices that are likely to be optimal.
This systematic review will provide evidence of current practices to inform approaches for involving patients and other stakeholders in the development of patient decision aids. We anticipate that the results will help move towards the establishment of best practices for the development of patient-centered tools and, in turn, help improve the experiences of people who face difficult health decisions.
Systematic review registration
Electronic supplementary material
The online version of this article (doi:10.1186/2046-4053-4-11) contains supplementary material, which is available to authorized users.
Patient decision aids; Decision support; Shared decision-making; Patient education; Counseling; User-centered design; Human-centered design; Patient partnership; Stakeholder engagement; Implementation; Knowledge translation; Patient-centered care
The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.
We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.
We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University –ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University – Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments.
Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts.
Health-care organizations need to be ready prior to implement evidence-based interventions. In this study, we sought to achieve consensus on a framework to assess the readiness of health-care organizations to implement evidence-based interventions in the context of chronic care.
We conducted a web-based modified Delphi study between March and May 2013. We contacted 76 potentially eligible international experts working in the fields of organizational readiness (OR), knowledge translation (KT), and chronic care to comment upon the 76 elements resulting from our proposed conceptual map. This conceptual map was based on a systematic review of the existing frameworks of Organizational Readiness for Change (ORC) in health-care. We developed a conceptual map that proposed a set of core concepts and their associated 17 dimensions and 59 sub-dimensions. Experts rated their agreement concerning the applicability and importance of ORC elements on a 5-point Likert scale, where 1 indicates total disagreement and 5 indicates total agreement. Two rounds were needed to get a consensus from the experts. Consensus was a priori defined as strong (≥75%) or moderate (60-74%). Simple descriptive statistics was used.
In total, 14 participants completed the first round and 10 completed the two rounds. Panel members reached consensus on the applicability and importance of 6 out of 17 dimensions and 28 out of 59 sub-dimensions to assess OR for KT in the context of chronic care. A strong level of consensus (≥75%) was attained on the Organizational contextual factors, Leadership/participation, Organizational support, and Motivation dimensions. The Organizational climate for change and Change content dimensions reached a moderate consensus (60-74%). Experts also reached consensus on 28 out of 59 sub-dimensions to assess OR for KT. Twenty-one sub-dimensions reached a strong consensus (≥75%) and seven a moderate consensus (60-74%).
This study results provided the most important and applicable dimensions and sub-dimensions for assessing OR-KT in the context of chronic care. They can be used to guide the design of an assessment tool to improve knowledge translation in the field of chronic care.
Organizational readiness; Delphi study; Knowledge translation; Chronic care; Measurement
Decision boxes (Dboxes) provide clinicians with research evidence about management options for medical questions that have no single best answer. Dboxes fulfil a need for rapid clinical training tools to prepare clinicians for clinician-patient communication and shared decision-making. We studied the barriers and facilitators to using the Dbox information in clinical practice.
We used a mixed methods study with sequential explanatory design. We recruited family physicians, residents, and nurses from six primary health-care clinics. Participants received eight Dboxes covering various questions by email (one per week). For each Dbox, they completed a web questionnaire to rate clinical relevance and cognitive impact and to assess the determinants of their intention to use what they learned from the Dbox to explain to their patients the advantages and disadvantages of the options, based on the theory of planned behaviour (TPB). Following the 8-week delivery period, we conducted focus groups with clinicians and interviews with clinic administrators to explore contextual factors influencing the use of the Dbox information.
One hundred clinicians completed the web surveys. In 54% of the 496 questionnaires completed, they reported that their practice would be improved after having read the Dboxes, and in 40%, they stated that they would use this information for their patients. Of those who would use the information for their patients, 89% expected it would benefit their patients, especially in that it would allow the patient to make a decision more in keeping with his/her personal circumstances, values, and preferences. They intended to use the Dboxes in practice (mean 5.6 ± 1.2, scale 1–7, with 7 being “high”), and their intention was significantly related to social norm, perceived behavioural control, and attitude according to the TPB (P < 0.0001). In focus groups, clinicians mentioned that co-interventions such as patient decision aids and training in shared decision-making would facilitate the use of the Dbox information. Some participants would have liked a clear “bottom line” statement for each Dbox and access to printed Dboxes in consultation rooms.
Dboxes are valued by clinicians. Tailoring of Dboxes to their needs would facilitate their implementation in practice.
Electronic supplementary material
The online version of this article (doi:10.1186/s13012-014-0144-6) contains supplementary material, which is available to authorized users.
Clinical practice guidelines; Knowledge translation; Decision support; Evidence-based practice; Barriers; Patient-centred care; User experience; Continuing professional development; Communication competency
Little is known about factors influencing professionals’ use of wikis.
We developed and validated two questionnaires to assess health care professionals’ intention to use wiki-based reminders for the management of trauma patients.
We developed questionnaires for emergency physicians (EPs) and allied health professions (AHPs) based on the Theory of Planned Behavior and adapted them to the salient beliefs of each, identified in an earlier study. Items measured demographics and direct and indirect theoretical constructs. We piloted the questionnaires with 2 focus groups (5 EPs and 5 AHPs) to identify problems of wording and length. Based on feedback, we adjusted the wording and combined certain items. A new convenience sample of 25 EPs and 26 AHPs then performed a test-retest of the questionnaires at a 2-week interval. We assessed internal consistency using Cronbach alpha coefficients and temporal stability of items with an agreement intraclass correlation coefficient (ICC).
Five EPs and 5 AHPs (3 nurses, 1 respiratory therapist, and 1 pharmacist) formed 2 focus groups; 25 EPs and 26 AHPs (12 nurses, 7 respiratory therapists, and 7 pharmacists) completed the test and retest. The EP questionnaire test-retest scores for consistency (Cronbach alpha) and stability (ICC) were intention (test: Cronbach alpha=.94; retest: Cronbach alpha=.98; ICC=.89), attitude (.74, .72, .70), subjective norm (.79, .78, .75), perceived behavioral control (.67, .65, .66), attitudinal beliefs (.94, .86, .60), normative beliefs (.83, .87, .79), and control beliefs barriers (.58, .67, .78) and facilitators (.97, .85, .30). The AHP questionnaire scores for consistency and stability were: intention (test Cronbach alpha=.69, retest Cronbach alpha=.81, ICC=.48), attitude (.85, .87, .83), subjective norm (.47, .82, .62), perceived behavioral control (.55, .62, .60), attitudinal beliefs (.92, .91, .82), normative beliefs (.85, .90, .74), and control beliefs barriers (.58, .55, .66) and facilitators (.72, .94, –.05). To improve the psychometric properties of both questionnaires, we reformulated poorly consistent or unstable items.
Our new theory-based questionnaires to measure health care professionals’ intention to use wiki-based reminders have adequate validity and reliability for use in large surveys. In the long run, they can be used to develop a theory-based implementation intervention for a wiki promoting best practices in trauma care.
knowledge translation; wiki; collaborative writing applications; decision support tools; health informatics; Theory of Planned Behavior; trauma care; traumatic brain injury; interprofessional collaboration
Shared Decision Making (SDM) is increasingly advocated as a model for medical decision making. However, there is still low use of SDM in clinical practice. High impact factor journals might represent an efficient way for its dissemination. We aimed to identify and characterize publication trends of SDM in 15 high impact medical journals.
We selected the 15 general and internal medicine journals with the highest impact factor publishing original articles, letters and editorials. We retrieved publications from 1996 to 2011 through the full-text search function on each journal website and abstracted bibliometric data. We included publications of any type containing the phrase “shared decision making” or five other variants in their abstract or full text. These were referred to as SDM publications. A polynomial Poisson regression model with logarithmic link function was used to assess the evolution across the period of the number of SDM publications according to publication characteristics.
We identified 1285 SDM publications out of 229,179 publications in 15 journals from 1996 to 2011. The absolute number of SDM publications by journal ranged from 2 to 273 over 16 years. SDM publications increased both in absolute and relative numbers per year, from 46 (0.32% relative to all publications from the 15 journals) in 1996 to 165 (1.17%) in 2011. This growth was exponential (P < 0.01). We found fewer research publications (465, 36.2% of all SDM publications) than non-research publications, which included non-systematic reviews, letters, and editorials. The increase of research publications across time was linear. Full-text search retrieved ten times more SDM publications than a similar PubMed search (1285 vs. 119 respectively).
This review in full-text showed that SDM publications increased exponentially in major medical journals from 1996 to 2011. This growth might reflect an increased dissemination of the SDM concept to the medical community.
Shared decision making; Bibliometric analysis; Decision making; Full text search; Review; Information storage and retrieval; PubMed; Text mining
Theory-based process evaluations conducted alongside randomized controlled trials provide the opportunity to investigate hypothesized mechanisms of action of interventions, helping to build a cumulative knowledge base and to inform the interpretation of individual trial outcomes. Our objective was to identify the underlying causal mechanisms in a cluster randomized trial of the effectiveness of printed educational materials (PEMs) to increase referral for diabetic retinopathy screening. We hypothesized that the PEMs would increase physicians’ intention to refer patients for retinal screening by strengthening their attitude and subjective norm, but not their perceived behavioral control.
Design: A theory based process evaluation alongside the Ontario Printed Educational Material (OPEM) cluster randomized trial. Postal surveys based on the Theory of Planned Behavior were sent to a random sample of trial participants two months before and six months after they received the intervention. Setting: Family physicians in Ontario, Canada. Participants: 1,512 family physicians (252 per intervention group) from the OPEM trial were invited to participate, and 31.3% (473/1512) responded at time one and time two. The final sample comprised 437 family physicians fully completing questionnaires at both time points. Main outcome measures: Primary: behavioral intention related to referring patient for retinopathy screening; secondary: attitude, subjective norm, perceived behavioral control.
At baseline, family physicians reported positive intention, attitude, subjective norm, and perceived behavioral control to advise patients about retinopathy screening suggesting limited opportunities for improvement in these constructs. There were no significant differences on intention, attitude, subjective norm, and perceived behavioral control following the intervention. Respondents also reported additional physician- and patient-related factors perceived to influence whether patients received retinopathy screening.
Lack of change in the primary and secondary theory-based outcomes provides an explanation for the lack of observed effect of the main OPEM trial. High baseline levels of intention to advise patients to attend retinopathy screening suggest that post-intentional and other factors may explain gaps in care. Process evaluations based on behavioral theory can provide replicable and generalizable insights to aid interpretation of randomized controlled trials of complex interventions to change health professional behavior.
Electronic supplementary material
The online version of this article (doi:10.1186/1748-5908-9-86) contains supplementary material, which is available to authorized users.
Process evaluation; Theory of planned behavior; Printed educational material; Healthcare professional behavior; Behavior change
Aim. The purpose of this study is to evaluate the impact, among nurses in hospital settings, of a questionnaire-based implementation intentions intervention on notification of potential ocular tissue donors to donation stakeholders. Methods. This randomized intervention was clustered at the level of hospital departments with two study arms: questionnaire-based implementation intentions intervention and control. In the intervention group, nurses were asked to plan specific actions if faced with a number of barriers when reporting potential ocular donors. The primary outcome was the potential ocular tissue donors' notification rate before and after the intervention. Analysis was based on a generalized linear model with an identity link and a binomial distribution. Results. We compared outcomes in 26 departments from 5 hospitals, 13 departments per condition. The implementation intentions intervention did not significantly increase the notification rate of ocular tissue donors (intervention: 23.1% versus control: 21.1%; χ2 = 1.14, 2; P = 0.56). Conclusion. A single and brief implementation intentions intervention among nurses did not modify the notification rate of potential ocular tissue donors to donation stakeholders. Low exposure to the intervention was a major challenge in this study. Further studies should carefully consider a multicomponent intervention to increase exposure to this type of intervention.
Within the context of an exploratory case study, the authors assessed the perceptions of family caregivers about the decision-making process regarding relocating their relative and about the applicability of an interprofessional approach to shared decision making (IP-SDM). They also assessed perceptions of health professionals and health managers about IP-SDM.
From November 2010 to October 2011, we worked with one IP home care team dedicated to older adults (the case) from a large primary health care organization in Quebec City, Canada. We identified six of their clients who had faced a decision about whether to stay at home or move to a long-term care facility in the past year and interviewed their family caregivers. We explored the decision-making process they had experienced regarding relocating their relative and their perceptions about the applicability of IP-SDM in this context. Attitudes towards IP-SDM and potential barriers to this approach were explored using a focus group with the participating IP home care team, individual interviews with 8 managers and a survey of 272 health professionals from the primary care organization. A hybrid process of inductive and deductive thematic analysis was used and data were triangulated across all sources.
Family caregivers reported lack of agreement on the nature of the decision to be made, a disconnection between home care services and relatives’ needs, and high cost of long-term care alternatives. Factors influencing their decision included their ability to provide care for their relative. While they felt somewhat supported by the IP home care team, they also felt pressured in the decision. Overall, they did not perceive they had been exposed to IP-SDM but agreed that it was applicable in this context. Results from the survey, focus group and interviews with health professionals and managers indicated they all had a favourable attitude towards IP-SDM but many barriers hampered its implementation in their practice.
The family caregivers in this study did not experience IP-SDM when relocating their relative. Added to results obtained with health professionals and managers, this highlights the need for an effective intervention targeting identified barriers to implementing IP-SDM in this context.
Shared decision making; Interprofessionalism; Home care; Older adults; Qualitative methods; Case study; Family caregivers
Public and patient involvement in the different stages of the health technology assessment (HTA) process is increasingly encouraged. The selection of topics for assessment, which includes identifying and prioritizing HTA questions, is a constant challenge for HTA agencies because the number of technologies requiring an assessment exceeds the resources available. Public and patient involvement in these early stages of HTA could make assessments more relevant and acceptable to them. Involving them in the development of the assessment plan is also crucial to optimize their influence and impact on HTA research. The project objectives are: 1) setting up interventions to promote patient participation in three stages of the HTA process: identification of HTA topics, prioritization, and development of the assessment plan of the topic prioritized; and 2) assessing the impact of patient participation on the relevance of the topics suggested, the prioritization process, and the assessment plan from the point of view of patients and other groups involved in HTA.
Patients and their representatives living in the catchment area of the HTA Roundtable of Université Laval’s Integrated University Health Network (covering six health regions of the Province of Quebec, Canada) will be involved in the following HTA activities: 1) identification of potential HTA topics in the field of cancer; 2) revision of vignettes developed to inform the prioritization of topics; 3) participation in deliberation sessions for prioritizing HTA topics; and 4) development of the assessment plan of the topic prioritized. The research team will coordinate the implementation of these activities and will evaluate the process and outcomes of patient involvement through semi-structured interviews with representatives of the different stakeholder groups, structured observations, and document analysis, mainly involving the comparison of votes and topics suggested by various stakeholder groups.
This project is designed as an integrated approach to knowledge translation and will be conducted through a close collaboration between researchers and knowledge users at all stages of the project. In response to the needs expressed by HTA producers, the knowledge produced will be directly useful in guiding practices regarding patient involvement in the early phases of HTA.
Public and patient participation; Research priorities; Health technology assessment; Public involvement; Knowledge translation
Clinical practice guidelines aim to improve the health of patients by guiding individual care in clinical settings. Many guidelines specifically about health promotion or primary disease prevention are beginning to support informed patient choice, and suggest that clinicians and patients engage in shared discussions to determine how best to tailor guidelines to individuals. However, guidelines generally do not address how to translate evidence from the population to the individual in clinical practice, or how to engage patients in these discussions. In addition, they often fail to reconcile patients’ preferences and social norms with best evidence. Shared decision making (SDM) is one solution to bridge guidelines about health promotion and disease prevention with clinical practice. SDM describes a collaborative process between patients and their clinicians to reach agreement about a health decision involving multiple medically appropriate treatment options. This paper discusses: 1) a brief overview of SDM; 2) the potential role of SDM in facilitating the implementation of prevention-focused practice guidelines for both preference-sensitive and effective care decisions; and 3) avenues for future empirical research to test how best to engage individual patients and clinicians in these complex discussions about prevention guidelines. We suggest that SDM can provide a structure for clinicians to discuss clinical practice guidelines with patients in a way that is evidence-based, patient-centered, and incorporates patients’ preferences. In addition to providing a model for communicating about uncertainty at the individual level, SDM can provide a platform for engaging patients in a conversation. This process can help manage patients’ and clinicians’ expectations about health behaviors. SDM can be used even in situations with strong evidence for benefits at the level of the population, by helping patients and clinicians prioritize behaviors during time-pressured medical encounters. Involving patients in discussions could lead to improved health through better adherence to chosen options, reduced practice variation about preference-sensitive options, and improved care more broadly. However, more research is needed to determine the impact of this approach on outcomes such as morbidity and mortality.
shared decision making; practice guidelines; patient–clinician communication
This systematic review of mixed methods studies focuses on factors that can facilitate or limit the implementation of information and communication technologies (ICTs) in clinical settings. Systematic searches of relevant bibliographic databases identified studies about interventions promoting ICT adoption by healthcare professionals. Content analysis was performed by two reviewers using a specific grid. One hundred and one (101) studies were included in the review. Perception of the benefits of the innovation (system usefulness) was the most common facilitating factor, followed by ease of use. Issues regarding design, technical concerns, familiarity with ICT, and time were the most frequent limiting factors identified. Our results suggest strategies that could effectively promote the successful adoption of ICT in healthcare professional practices.
PMID: 20703721 CAMSID: cams382
Systematic review; Adoption factors; Information and communication technologies (ICTs); ICT adoption by healthcare professionals
This study aimed to understand how different types of knowledge have influenced the decision making process regarding the implementation of telehomecare in the organization of regional healthcare services in the Province of Quebec (Canada). A case study was conducted in order to explore how scientific evidence was integrated in the decision-making processes regarding the implementation of a telehomecare system in the Gaspésie–Magdalene Islands Health Region. A total of 14 semistructured interviews were completed with key organizational decision makers (regional managers, organization managers, healthcare professionals, and technological managers). Two researchers independently carried out data analysis, encouraging iterations and validation with study participants. The Gaspésie–Magdalene Islands Telehomecare Project is based on a technological solution named Intelligent Distance Patient Monitoring and constitutes a relevant example of the evolution of an e-health solution. Indeed, the first reports of the experiment influenced decision makers to continue the deployment of the solution. Decision makers from all groups agreed on the importance of using past experience to avoid pitfalls and ensure an optimal decision-making process. They highlighted the importance of knowledge translation between sites as well as within sites. Knowledge translation played an important part in the success of the project. Efficient strategies to transfer evidence to organizational decision making have been identified such as an end-users forum, where researchers provide support by sharing evidence with end-users and actively participate in knowledge translation.
PMID: 19292630 CAMSID: cams380
telehomecare; scientific evidence; Intelligent Distance Patient Monitoring
Information and communication technologies (ICT) are defined as digital and analogue technologies that facilitate the capturing, processing, storage and exchange of information via electronic communication. ICTs have the potential to improve information management, access to health services, quality of care, continuity of services, and cost containment. Knowledge is lacking on conditions for successful ICT integration into practice.
To carry out a systematic review of the effectiveness of interventions to promote the adoption of ICT by healthcare professionals.
Specific strategies, defined with the help of an information specialist, were used to search the Cochrane Effective Practice and Organisation of Care Group (EPOC) register and additional relevant databases. We considered studies published from January 1990 until October 2007.
Randomised controlled trials (RCTs), controlled clinical trials (CCTs), controlled before/after studies (CBAs), and interrupted time series (ITS) that reported objectively measured outcomes concerning the effect of interventions to promote adoption of ICT in healthcare professionals’ practices.
Data collection and analysis
Two reviewers independently assessed each potentially relevant study for inclusion. We resolved discrepancies by discussion or a third reviewer. Two teams of two reviewers independently extracted data and assessed the quality of included studies. A meta-analysis of study outcomes was not possible, given the small number of included studies and the heterogeneity of intervention and outcomes measures. We conducted qualitative analyses, and have presented the results in a narrative format.
Ten studies met the inclusion criteria. Nine of them were RCTs. All studies involved physicians as participants (including postgraduate trainees), and one study also included other participants. Only two studies measured patient outcomes. Searching skills and/or frequency of use of electronic databases, mainly MEDLINE, were targeted in eight studies. Use of Internet for audit and feedback, and email for provider-patient communication, were targeted in two studies. Four studies showed small to moderate positive effects of the intervention on ICT adoption. Four studies were unable to demonstrate significant positive effects, and the two others showed mixed effects. No studies looked at the long-term effect or sustainability of the intervention.
There is very limited evidence on effective interventions promoting the adoption of ICTs by healthcare professionals. Small effects have been reported for interventions targeting the use of electronic databases and digital libraries. The effectiveness of interventions to promote ICT adoption in healthcare settings remains uncertain, and more well designed trials are needed.
PMID: 19160265 CAMSID: cams377
Databases, Bibliographic [utilization]; Health Personnel [*statistics & numerical data]; Information Storage and Retrieval [*utilization]; Professional Practice [*statistics & numerical data]; Randomized Controlled Trials as Topic
Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions.
Methods and Findings
Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85.
A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance.
Online consumer health information addresses health problems, self-care, disease prevention, and health care services and is intended for the general public. Using this information, people can improve their knowledge, participation in health decision-making, and health. However, there are no comprehensive instruments to evaluate the value of health information from a consumer perspective.
We collaborated with information providers to develop and validate the Information Assessment Method for all (IAM4all) that can be used to collect feedback from information consumers (including patients), and to enable a two-way knowledge translation between information providers and consumers.
Content validation steps were followed to develop the IAM4all questionnaire. The first version was based on a theoretical framework from information science, a critical literature review and prior work. Then, 16 laypersons were interviewed on their experience with online health information and specifically their impression of the IAM4all questionnaire. Based on the summaries and interpretations of interviews, questionnaire items were revised, added, and excluded, thus creating the second version of the questionnaire. Subsequently, a panel of 12 information specialists and 8 health researchers participated in an online survey to rate each questionnaire item for relevance, clarity, representativeness, and specificity. The result of this expert panel contributed to the third, current, version of the questionnaire.
The current version of the IAM4all questionnaire is structured by four levels of outcomes of information seeking/receiving: situational relevance, cognitive impact, information use, and health benefits. Following the interviews and the expert panel survey, 9 questionnaire items were confirmed as relevant, clear, representative, and specific. To improve readability and accessibility for users with a lower level of literacy, 19 items were reworded and all inconsistencies in using a passive or active voice have been solved. One item was removed due to redundancy. The current version of the IAM4all questionnaire contains 28 items.
We developed and content validated the IAM4all in partnership with information providers, information specialists, researchers and representatives of information consumers. This questionnaire can be integrated within electronic knowledge resources to stimulate users’ reflection (eg, their intention to use information). We claim that any organization (eg, publishers, community organizations, or patient associations), can evaluate and improve their online consumer health information from a consumers’ perspective using this method.
information use; information retrieval; push technology; consumer health information; consumer-centered outcomes; content validity
Shared decision making is now making inroads in health care professionals’ continuing education curriculum, but there is no consensus on what core competencies are required by clinicians for effectively involving patients in health-related decisions. Ready-made programs for training clinicians in shared decision making are in high demand, but existing programs vary widely in their theoretical foundations, length, and content. An international, interdisciplinary group of 25 individuals met in 2012 to discuss theoretical approaches to making health-related decisions, compare notes on existing programs, take stock of stakeholders concerns, and deliberate on core competencies. This article summarizes the results of those discussions. Some participants believed that existing models already provide a sufficient conceptual basis for developing and implementing shared decision making competency-based training programs on a wide scale. Others argued that this would be premature as there is still no consensus on the definition of shared decision making or sufficient evidence to recommend specific competencies for implementing shared decision making. However, all participants agreed that there were 2 broad types of competencies that clinicians need for implementing shared decision making: relational competencies and risk communication competencies. Further multidisciplinary research could broaden and deepen our understanding of core competencies for shared decision making training.
PMID: 24347105 CAMSID: cams3819
shared decision making; education; patient-centered care; implementation science; theory; risk communication
DECISION + 2, a training program for physicians, is designed to implement shared decision making (SDM) in the context of antibiotics use for acute respiratory tract infections (ARTIs). We evaluated the impact of DECISION + 2 on SDM implementation as assessed by patients and physicians, and on physicians’ intention to engage in SDM.
From 2010 to 2011, a multi-center, two-arm, parallel randomized clustered trial appraised the effects of DECISION + 2 on the decision to use antibiotics for patients consulting for ARTIs. We randomized 12 family practice teaching units (FPTUs) to either DECISION + 2 or usual care. After the consultation, both physicians and patients independently completed questionnaires based on the D-Option scale regarding SDM behaviors during the consultation. Patients also answered items assessing the role they assumed during the consultation (active/collaborative/passive). Before and after the intervention, physicians completed a questionnaire based on the Theory of Planned Behavior to measure their intention to engage in SDM. To account for the cluster design, we used generalized estimating equations and generalized linear mixed models to assess the impact of DECISION + 2 on the outcomes of interest.
A total of 270 physicians (66% women) participated in the study. After DECISION + 2, patients’ D-Option scores were 80.1 ± 1.1 out of 100 in the intervention group and 74.9 ± 1.1 in the control group (p = 0.001). Physicians’ D-Option scores were 79.7 ± 1.8 in the intervention group and 76.3 ± 1.9 in the control group (p = 0.2). However, subgroup analyses showed that teacher physicians D-Option scores were 79.7 ± 1.5 and 73.0 ± 1.4 respectively (p = 0.001). More patients reported assuming an active or collaborative role in the intervention group (67.1%), than in the control group (49.2%) (p = 0.04). There was a significant relation between patients’ and physicians’ D-Option scores (p < 0.01) and also between patient-reported assumed roles and both D-Option scores (as assessed by patients, p < 0.01; and physicians, p = 0.01). DECISION + 2 had no impact on the intention of physicians to engage in SDM.
DECISION + 2 positively influenced SDM behaviors as assessed by patients and teacher physicians. Physicians’ intention to engage in SDM was not affected by DECISION + 2.
ClinicalTrials.gov trials register no. NCT01116076.
Shared decision making; Implementation; Theory of planned behavior; Training
Two decades of research has established the positive effect of using patient-targeted decision support interventions: patients gain knowledge, greater understanding of probabilities and increased confidence in decisions. Yet, despite their efficacy, the effectiveness of these decision support interventions in routine practice has yet to be established; widespread adoption has not occurred. The aim of this review was to search for and analyze the findings of published peer-reviewed studies that investigated the success levels of strategies or methods where attempts were made to implement patient-targeted decision support interventions into routine clinical settings.
An electronic search strategy was devised and adapted for the following databases: ASSIA, CINAHL, Embase, HMIC, Medline, Medline-in-process, OpenSIGLE, PsycINFO, Scopus, Social Services Abstracts, and the Web of Science. In addition, we used snowballing techniques. Studies were included after dual independent assessment.
After assessment, 5322 abstracts yielded 51 articles for consideration. After examining full-texts, 17 studies were included and subjected to data extraction. The approach used in all studies was one where clinicians and their staff used a referral model, asking eligible patients to use decision support. The results point to significant challenges to the implementation of patient decision support using this model, including indifference on the part of health care professionals. This indifference stemmed from a reported lack of confidence in the content of decision support interventions and concern about disruption to established workflows, ultimately contributing to organizational inertia regarding their adoption.
It seems too early to make firm recommendations about how best to implement patient decision support into routine practice because approaches that use a ‘referral model’ consistently report difficulties. We sense that the underlying issues that militate against the use of patient decision support and, more generally, limit the adoption of shared decision making, are under-investigated and under-specified. Future reports from implementation studies could be improved by following guidelines, for example the SQUIRE proposals, and by adopting methods that would be able to go beyond the ‘barriers’ and ‘facilitators’ approach to understand more about the nature of professional and organizational resistance to these tools. The lack of incentives that reward the use of these interventions needs to be considered as a significant impediment.
Coaching and guidance are structured approaches that can be used within or alongside patient decision aids (PtDAs) to facilitate the process of decision making. Coaching is provided by an individual, and guidance is embedded within the decision support materials. The purpose of this paper is to: a) present updated definitions of the concepts “coaching” and “guidance”; b) present an updated summary of current theoretical and empirical insights into the roles played by coaching/guidance in the context of PtDAs; and c) highlight emerging issues and research opportunities in this aspect of PtDA design.
We identified literature published since 2003 on shared decision making theoretical frameworks inclusive of coaching or guidance. We also conducted a sub-analysis of randomized controlled trials included in the 2011 Cochrane Collaboration Review of PtDAs with search results updated to December 2010. The sub-analysis was conducted on the characteristics of coaching and/or guidance included in any trial of PtDAs and trials that allowed the impact of coaching and/or guidance with PtDA to be compared to another intervention or usual care.
Theoretical evidence continues to justify the use of coaching and/or guidance to better support patients in the process of thinking about a decision and in communicating their values/preferences with others. In 98 randomized controlled trials of PtDAs, 11 trials (11.2%) included coaching and 63 trials (64.3%) provided guidance. Compared to usual care, coaching provided alongside a PtDA improved knowledge and decreased mean costs. The impact on some other outcomes (e.g., participation in decision making, satisfaction, option chosen) was more variable, with some trials showing positive effects and other trials reporting no differences. For values-choice agreement, decisional conflict, adherence, and anxiety there were no differences between groups. None of these outcomes were worse when patients were exposed to decision coaching alongside a PtDA. No trials evaluated the effect of guidance provided within PtDAs.
Theoretical evidence continues to justify the use of coaching and/or guidance to better support patients to participate in decision making. However, there are few randomized controlled trials that have compared the effectiveness of coaching used alongside PtDAs to PtDAs without coaching, and no trials have compared the PtDAs with guidance to those without guidance.
With the persistent gaps between research and practice in healthcare systems, knowledge translation (KT) has gained significance and importance. Also, in most industrialized countries, there is an increasing emphasis on managing chronic health conditions with the best available evidence. Yet, organizations aiming to improve chronic care (CC) require an adequate level of organizational readiness (OR) for KT.
Objectives: The purpose of this study is to review and synthesize the existing evidence on conceptual models/frameworks of Organizational Readiness for Change (ORC) in healthcare as the basis for the development of a comprehensive framework of OR for KT in the context of CC.
We conducted a systematic review of the literature on OR for KT in CC using Pubmed, Embase, CINAHL, PsychINFO, Web of Sciences (SCI and SSCI), and others. Search terms included readiness; commitment and change; preparedness; willing to change; organization and administration; and health and social services.
Study selection: The search was limited to studies that had been published between the starting date of each bibliographic database (e.g., 1964 for PubMed) and November 1, 2012. Only papers that refer to a theory, a theoretical component from any framework or model on OR that were applicable to the healthcare domain were considered. We analyzed data using conceptual mapping.
Data extraction: Pairs of authors independently screened the published literature by reviewing their titles and abstracts. Then, the two same reviewers appraised the full text of each study independently.
Overall, we found and synthesized 10 theories, theoretical models and conceptual frameworks relevant to ORC in healthcare described in 38 publications. We identified five core concepts, namely organizational dynamics, change process, innovation readiness, institutional readiness, and personal readiness. We extracted 17 dimensions and 59 sub-dimensions related to these 5 concepts.
Our findings provide a useful overview for researchers interested in ORC and aims to create a consensus on the core theoretical components of ORC in general and of OR for KT in CC in particular. However, more work is needed to define and validate the core elements of a framework that could help to assess OR for KT in CC.
Organizational readiness; Conceptual models; Frameworks; Knowledge translation; Chronic care; Healthcare system
Collaborative writing applications (eg, wikis and Google Documents) hold the potential to improve the use of evidence in both public health and health care. The rapid rise in their use has created the need for a systematic synthesis of the evidence of their impact as knowledge translation (KT) tools in the health care sector and for an inventory of the factors that affect their use.
Through the Levac six-stage methodology, a scoping review was undertaken to explore the depth and breadth of evidence about the effective, safe, and ethical use of wikis and collaborative writing applications (CWAs) in health care.
Multiple strategies were used to locate studies. Seven scientific databases and 6 grey literature sources were queried for articles on wikis and CWAs published between 2001 and September 16, 2011. In total, 4436 citations and 1921 grey literature items were screened. Two reviewers independently reviewed citations, selected eligible studies, and extracted data using a standardized form. We included any paper presenting qualitative or quantitative empirical evidence concerning health care and CWAs. We defined a CWA as any technology that enables the joint and simultaneous editing of a webpage or an online document by many end users. We performed qualitative content analysis to identify the factors that affect the use of CWAs using the Gagnon framework and their effects on health care using the Donabedian framework.
Of the 111 studies included, 4 were experimental, 5 quasi-experimental, 5 observational, 52 case studies, 23 surveys about wiki use, and 22 descriptive studies about the quality of information in wikis. We classified them by theme: patterns of use of CWAs (n=26), quality of information in existing CWAs (n=25), and CWAs as KT tools (n=73). A high prevalence of CWA use (ie, more than 50%) is reported in 58% (7/12) of surveys conducted with health care professionals and students. However, we found only one longitudinal study showing that CWA use is increasing in health care. Moreover, contribution rates remain low and the quality of information contained in different CWAs needs improvement. We identified 48 barriers and 91 facilitators in 4 major themes (factors related to the CWA, users’ knowledge and attitude towards CWAs, human environment, and organizational environment). We also found 57 positive and 23 negative effects that we classified into processes and outcomes.
Although we found some experimental and quasi-experimental studies of the effectiveness and safety of CWAs as educational and KT interventions, the vast majority of included studies were observational case studies about CWAs being used by health professionals and patients. More primary research is needed to find ways to address the different barriers to their use and to make these applications more useful for different stakeholders.
collaborative writing applications; collaborative authoring; knowledge management; crowdsourcing; medical informatics; ehealth; Internet; Wiki; Wikipedia; Google Docs; Google Knol; Web 2.0; knowledge translation; evidence-based medicine; participatory med
To compare the ability of users of 2 medical search engines, InfoClinique and the Trip database, to provide correct answers to clinical questions and to explore the perceived effects of the tools on the clinical decision-making process.
Three family medicine units of the family medicine program of the Faculty of Medicine at Laval University in Quebec city, Que.
Fifteen second-year family medicine residents.
Residents generated 30 structured questions about therapy or preventive treatment (2 questions per resident) based on clinical encounters. Using an Internet platform designed for the trial, each resident answered 20 of these questions (their own 2, plus 18 of the questions formulated by other residents, selected randomly) before and after searching for information with 1 of the 2 search engines. For each question, 5 residents were randomly assigned to begin their search with InfoClinique and 5 with the Trip database.
Main outcome measures
The ability of residents to provide correct answers to clinical questions using the search engines, as determined by third-party evaluation. After answering each question, participants completed a questionnaire to assess their perception of the engine’s effect on the decision-making process in clinical practice.
Of 300 possible pairs of answers (1 answer before and 1 after the initial search), 254 (85%) were produced by 14 residents. Of these, 132 (52%) and 122 (48%) pairs of answers concerned questions that had been assigned an initial search with InfoClinique and the Trip database, respectively. Both engines produced an important and similar absolute increase in the proportion of correct answers after searching (26% to 62% for InfoClinique, for an increase of 36%; 24% to 63% for the Trip database, for an increase of 39%; P = .68). For all 30 clinical questions, at least 1 resident produced the correct answer after searching with either search engine. The mean (SD) time of the initial search for each question was 23.5 (7.6) minutes with InfoClinique and 22.3 (7.8) minutes with the Trip database (P = .30). Participants’ perceptions of each engine’s effect on the decision-making process were very positive and similar for both search engines.
Family medicine residents’ ability to provide correct answers to clinical questions increased dramatically and similarly with the use of both InfoClinique and the Trip database. These tools have strong potential to increase the quality of medical care.