Modifying the format and content of guidelines may facilitate their use and lead to improved quality of care. We reviewed the medical literature to identify features desired by different users and associated with guideline use to develop a framework of implementability and found that most guidelines do not contain these elements. Further research is needed to develop and evaluate implementability tools.
We are launching the Guideline Implementability Research and Application Network (GIRAnet) to enable the development and testing of implementability tools in three domains: Resource Implications, Implementation, and Evaluation. Partners include the Guidelines International Network (G-I-N) and its member guideline developers, implementers, and researchers. In phase one, international guidelines will be examined to identify and describe exemplar tools. Indication-specific and generic tools will populate a searchable repository. In phase two, qualitative analysis of cognitive interviews will be used to understand how developers can best integrate implementability tools in guidelines and how health professionals use them for interpreting and applying guidelines. In phase three, a small-scale pilot test will assess the impact of implementability tools based on quantitative analysis of chart-based behavioural outcomes and qualitative analysis of interviews with participants. The findings will be used to plan a more comprehensive future evaluation of implementability tools.
Infrastructure funding to establish GIRAnet will be leveraged with the in-kind contributions of collaborating national and international guideline developers to advance our knowledge of implementation practice and science. Needs assessment and evaluation of GIRAnet will provide a greater understanding of how to develop and sustain such knowledge-exchange networks. Ultimately, by facilitating use of guidelines, this research may lead to improved delivery and outcomes of patient care.
Guidelines; Guideline development; Guideline implementation; Research networks; Knowledge exchange
Practice guidelines can improve health care delivery and outcomes but several issues challenge guideline adoption, including their intrinsic attributes, and whether and how they are implemented. It appears that guideline format may influence accessibility and ease of use, which may overcome attitudinal barriers of guideline adoption, and appear to be important to all stakeholders. Guideline content may facilitate various forms of decision making about guideline adoption relevant to different stakeholders. Knowledge and attitudes about, and incentives and capacity for implementation on the part of guideline sponsors may influence whether and how they develop guidelines containing these features, and undertake implementation. Examination of these issues may yield opportunities to improve guideline adoption.
The attributes hypothesized to facilitate adoption will be expanded by thematic analysis, and quantitative and qualitative summary of the content of international guidelines for two primary care (diabetes, hypertension) and institutional care (chronic ulcer, chronic heart failure) topics. Factors that influence whether and how guidelines are implemented will be explored by qualitative analysis of interviews with individuals affiliated with guideline sponsoring agencies.
Previous research examined guideline implementation by measuring rates of compliance with recommendations or associated outcomes, but this produced little insight on how the products themselves, or their implementation, could be improved. This research will establish a theoretical basis upon which to conduct experimental studies to compare the cost-effectiveness of interventions that enhance guideline development and implementation capacity. Such studies could first examine short-term outcomes predictive of guideline utilization, such as recall, attitude toward, confidence in, and adoption intention. If successful, then long-term objective outcomes reflecting the adoption of processes and associated patient care outcomes could be evaluated.
Guidelines are important tools that inform healthcare delivery based on best available research evidence. Guideline use is in part based on quality of the guidelines, which includes advice for implementation and has been shown to vary. Others hypothesized this is due to limited instructions in guideline development manuals. The purpose of this study was to examine manual instructions for implementation advice.
We used a directed and summative content analysis approach based on an established framework of guideline implementability. Six manuals identified by another research group were examined to enumerate implementability domains and elements.
Manuals were similar in content but lacked sufficient detail in particular domains. Most frequently this was Accomodation, which includes information that would help guideline users anticipate and/or overcome organizational and system level barriers. In more than one manual, information was also lacking for Communicability, information that would educate patients or facilitate their involvement in shared decision making, and Applicability, or clinical parameters to help clinicians tailor recommendations for individual patients.
Most manuals that direct guideline development lack complete information about incorporating implementation advice. These findings can be used by those who developed the manuals to consider expanding their content in these domains. It can also be used by guideline developers as they plan the content and implementation of their guidelines so that the two are integrated. New approaches for guideline development and implementation may need to be developed. Use of guidelines might be improved if they included implementation advice, but this must be evaluated through ongoing research.
Guideline development; Guideline implementation; Implementability
Theories from social and behavioural science can make an important
contribution to the process of developing a conceptual framework for
improving use of clinical practice guidelines and clinician performance. A
conceptual framework for guideline dissemination and implementation is
presented which draws on relevant concepts from diffusion of innovation
theory, the transtheoretical model of behaviour change, health education
theory, social influence theory, and social ecology, as well as evidence
from systematic literature reviews on the effectiveness of various
behaviour change strategies. The framework emphasises the need for
pre-implementation assessment of (a) readiness of clinicians to adopt
guidelines into practice, (b) barriers to change as experienced by
clinicians, and (c) the level at which interventions should be targeted. It
also incorporates the need for multifaceted interventions, identifies the
type of barriers which will be addressed by each strategy, and develops the
concept of progression through stages of guideline adoption by clinicians,
with the use of appropriately targeted support strategies. The potential
value of the model is that it may enable those involved in the process of
guideline dissemination and implementation to direct strategies to target
groups more effectively. Clearly, the effectiveness and utility of the
model in facilitating guideline dissemination and implementation requires
validation by further empirical research. Until such research is available,
it provides a theoretical framework that may assist in the selection of
appropriate guideline dissemination and implementation strategies.
Prescriptive standards of clinical conduct--practice guidelines--have proliferated throughout medicine over the past decade. Practicing physicians are confronted with a plethora of guidelines developed for different purposes by a diverse body of public and private organizations. We review factors contributing to the growth of guidelines, their desirable features, and consequences, legal and otherwise, of implementing guidelines. Few studies have examined whether, and under what conditions, guidelines are effective in changing physicians' practices and patients' health. Nonetheless, expectations for guidelines remain high because they are one of the only instruments of health care reform that promises to improve the quality of care while reducing overall health care costs. Efforts to develop guidelines are likely to continue unabated for the foreseeable future. Additional research comparing different methods of developing and disseminating guidelines is needed.
Objective: To develop a guideline document model
that includes a sufficiently broad set of concepts to be useful throughout the
guideline life cycle.
Design: Current guideline document models are limited in that they
reflect the specific orientation of the stakeholder who created them; thus,
developers and disseminators often provide few constructs for conceptualizing
recommendations, while implementers de-emphasize concepts related to
establishing guideline validity. The authors developed the Guideline Elements
Model (GEM) using XML to better represent the heterogeneous knowledge
contained in practice guidelines. Core constructs were derived from the
Institute of Medicine's Guideline Appraisal Instrument, the National Guideline
Clearinghouse, and the augmented decision table guideline representation.
These were supplemented by additional concepts from a literature review.
Results: The GEM hierarchy includes more than 100 elements. Major
concepts relate to a guideline's identity, developer, purpose, intended
audience, method of development, target population, knowledge components,
testing, and review plan. Knowledge components in guideline documents include
recommendations (which in turn comprise conditionals and imperatives),
definitions, and algorithms.
Conclusion: GEM is more comprehensive than existing models and is
expressively adequate to represent the heterogeneous information contained in
guidelines. Use of XML contributes to a flexible, comprehensible, shareable,
and reusable knowledge representation that is both readable by human beings
and processible by computers.
Objective: To determine whether North American guidelines published subsequent to and in the same topic areas as those developed by the US Agency for Health Care Policy and Research (AHCPR) meet the same methodological criteria.
Study design: A guideline appraisal instrument containing 30 criteria was used to evaluate the methodological quality of the AHCPR guidelines, "updates" of the AHCPR guidelines authored by others, and guidelines that referenced or were adapted from the AHCPR guidelines. The frequency with which the criteria appeared in each guideline was compared and an analysis was performed to determine guidelines with two key features of the ACHPR guidelines—multidisciplinary guideline development panels and systematic reviews of the literature. Data were extracted from the guidelines by one investigator and then checked for accuracy by the other.
Results: Fifty two guidelines identified by broad based searches were evaluated. 50% of the criteria were present in every AHCPR guideline. The AHCPR guidelines scored 80% or more on 24 of the 30 criteria compared with 14 for the "updates" and 11 for those that referenced/adapted the AHCPR guidelines. All of the 17 AHCPR guidelines had both multidisciplinary development panels and systematic reviews of the literature compared with five from the other two categories (p<0.05).
Conclusions: North American guidelines developed subsequent to and in the same topic areas as the AHCPR guidelines are of substantially worse methodological quality and ignore key features important to guideline development. This finding contrasts with previously published conclusions that guideline methodological quality is improving over time.
Translating scientific evidence into daily practice is complex. Clinical guidelines can improve health care delivery, but there are a number of challenges in guideline adoption and implementation. Factors influencing the effective implementation of guidelines remain poorly understood. Understanding of barriers and facilitators is important for development of effective implementation strategies. The aim of this study was to determine perceived facilitators and barriers to guideline implementation and clinical compliance to guidelines for depression in psychiatric care.
This qualitative study was conducted at two psychiatric clinics in Stockholm, Sweden. The implementation activities at one of the clinics included local implementation teams, seminars, regular feedback and academic detailing. The other clinic served as a control and only received guidelines by post. Data were collected from three focus groups and 28 individual, semi-structured interviews. Content analysis was used to identify themes emerging from the interview data.
The identified barriers to, and facilitators of, the implementation of guidelines could be classified into three major categories: (1) organizational resources, (2) health care professionals' individual characteristics and (3) perception of guidelines and implementation strategies. The practitioners in the implementation team and at control clinics differed in three main areas: (1) concerns about control over professional practice, (2) beliefs about evidence-based practice and (3) suspicions about financial motives for guideline introduction.
Identifying the barriers to, and facilitators of, the adoption of recommendations is an important way of achieving efficient implementation strategies. The findings of this study suggest that the adoption of guidelines may be improved if local health professionals actively participate in an ongoing implementation process and identify efficient strategies to overcome barriers on an organizational and individual level. Getting evidence into practice and implementing clinical guidelines are dependent upon more than practitioners' motivation. There are factors in the local context, e.g. culture and leadership, evaluation, feedback on performance and facilitation, -that are likely to be equally influential.
Access to timely decision support information is critical for delivery of high-quality medical care. Transformation of clinical knowledge that is originally expressed in the form of a guideline to a computable format is one of the main obstacles to the integration of knowledge sharing functionality into computerized clinical systems. The Guideline Element Model (GEM) provides a methodology for such a transformation. Although the model has been used to store heterogeneous guideline knowledge, it is important to demonstrate that GEM markup facilitates guideline implementation. This report demonstrates the feasibility of implementation of GEM-encoded guideline recommendations using Apache Group s Cocoon Web Publishing Framework. We further demonstrate how XML-based programming allows for maintaining the separation of guideline content from processing logic and from presentation format. Finally, we analyze whether the guideline authors original intent has been sufficiently captured and conveyed to the end user.
Clinical guidelines are intended to improve healthcare. However, even if guidelines are excellent, their implementation is not assured. In subfertility care, the European Society of Human Reproduction and Embryology (ESHRE) guidelines have been inventoried, and their methodological quality has been assessed. To improve the impact of the ESHRE guidelines and to improve European subfertility care, it is important to optimise the implementability of guidelines. We therefore investigated the implementation barriers of the ESHRE guideline with the best methodological quality and evaluated the used instrument for usability and feasibility.
We reviewed the ESHRE guideline for the diagnosis and treatment of endometriosis to assess its implementability. We used an electronic version of the guideline implementability appraisal (eGLIA) instrument. This eGLIA tool consists of 31 questions grouped into 10 dimensions. Seven items address the guideline as a whole, and 24 items assess the individual recommendations in the guideline. The eGLIA instrument identifies factors that influence the implementability of the guideline recommendations. These factors can be divided into facilitators that promote implementation and barriers that oppose implementation. A panel of 10 experts from three European countries appraised all 36 recommendations of the guideline. They discussed discrepancies in a teleconference and completed a questionnaire to evaluate the ease of use and overall utility of the eGLIA instrument.
Two of the 36 guideline recommendations were straightforward to implement. Five recommendations were considered simply statements because they contained no actions. The remaining 29 recommendations were implementable with some adjustments. We found facilitators of the guideline implementability in the quality of decidability, presentation and formatting, apparent validity, and novelty or innovation of the recommendations. Vaguely defined actions, lack of facilities, immeasurable outcomes, and inflexibility within the recommendations formed barriers to implementation. The eGLIA instrument was generally useful and easy to use. However, assessment with the eGLIA instrument is very time-consuming.
The ESHRE guideline for the diagnosis and treatment of endometriosis could be improved to facilitate its implementation in daily practice. The eGLIA instrument is a helpful tool for identifying obstacles to implementation of a guideline. However, we recommend a concise version of this instrument.
International guidelines establish evidence-based standards for asthma care; however, recommendations are often not implemented and many patients do not meet control targets.
Regional pilot data demonstrated a knowledge-to-practice gap.
Choice of solutions
We engineered health system change in a multi-step approach described by the Canadian Institutes of Health Research knowledge translation framework.
Knowledge translation occurred at multiple levels: patient, practice and local health system. A regional administrative infrastructure and inter-disciplinary care teams were developed. The key project deliverable was a guideline-based interdisciplinary asthma management program. Six community organizations, 33 primary care physicians and 519 patients participated. The program operating cost was $290/patient.
Six guideline-based care elements were implemented, including spirometry measurement, asthma controller therapy, a written self-management action plan and general asthma education, including the inhaler device technique, role of medications and environmental control strategies in 93, 95, 86, 100, 97 and 87% of patients, respectively. Of the total patients 66% were adults, 61% were female, the mean age was 35.7 (SD = ±24.2) years. At baseline 42% had two or more symptoms beyond acceptable limits vs. 17% (P< 0.001) post-intervention; 71% reported urgent/emergent healthcare visits at baseline (2.94 visits/year) vs. 45% (1.45 visits/year) (P< 0.001); 39% reported absenteeism (5.0 days/year) vs. 19% (3.0 days/year) (P< 0.001). The mean follow-up interval was 22 (SD = ±7) months.
A knowledge-translation framework can guide multi-level organizational change, facilitate asthma guideline implementation, and improve health outcomes in community primary care practices. Program costs are similar to those of diabetes programs. Program savings offset costs in a ratio of 2.1:1
asthma; guideline adherence; implementation; knowledge translation; patient education as topic; primary care
Clinical Guidelines are a major tool for improving the quality of medical
care. Currently, a major research direction is automating the application
of guidelines at the point of care. To support that automation, several
requirements must be fulfilled, such as specification in a machine-interpretable
format, and connection to an electronic patent record. We
propose an innovative approach to guideline application, which
capitalizes on our Digital electronic Guidelines Library (DeGeL). The DeGeL framework includes a new hybrid model for incremental specification
of free-text guidelines, using several intermediate representations. The
new approach was implemented, in the case of the Asbru guideline
ontology, as the Spock system. Spock’s hybrid application engine supports application
of guideline represented at an intermediate format. Spock was evaluated
in a preliminary fashion by applying several guidelines to sample patient
Antiplatelet therapy is an evidence-based, guideline-recommended, worldwide standard of care for treatment of patients with atherothrombosis. However, clinical implementation of the guidelines is suboptimal, in part because of physician and patient nonadherence. The increased risk of bleeding associated with antiplatelet therapy is often the reason for nonadherence, and several programs have been created to increase adherence to guideline treatment recommendations. Despite the relative success of such initiatives, including Can Rapid Risk Stratification of Unstable Angina Patients Suppress Adverse Outcomes With Early Implementation of the ACC/AHA Guidelines, Guidelines Applied in Practice, and the American Heart Association's Get With the Guidelines and a Science Advisory, a current estimate is that less than 50% of atherothrombotic patients are taking antiplatelet therapies as recommended by national guidelines. A PubMed and MEDLINE search of the literature (January 1, 1983-May 15, 2008) was performed to examine the bleeding risks associated with various antiplatelet therapies. Relevant clinical trials, observational registry data, and other studies relevant to treatment and guideline recommendations were selected from articles generated through specific search terms. This comprehensive review contributes to the understanding of the benefit-to-risk ratio of antiplatelet therapy for patients with atherothrombosis.
The environmental scan is a tool that can be utilized to collect data to design health programs uniquely tailored to the needs of communities. However, it remains relatively undefined, unevaluated and underutilized in the field of public health. While individual studies indicate the utility of the environmental scan for public health, it is difficult to find a theoretical framework or guidelines on how to design, implement or evaluate the process within public health practice. The purpose of this study was to elicit lessons learned to maximize the utility of the environmental scan as a tool for public health. This process occurred through the development and implementation of an environmental scan as part of the needs-assessment phase of a project to increase cancer screening among African Americans in Baltimore, MD. Data collection methods for the environmental scan included a review of community stakeholders, cancer incidence and community assets and liabilities in target communities, focus-group sessions and key informant interviews with service providers. The environmental scan was conducted in 2003 and allowed for rapid acquisition and use of information about events, trends and relationships in the neighborhoods targeted for our project and enabled researchers to move forward with implementing the cancer-screening project. The researchers conclude that the environmental scan has considerable potential to be a creative, responsive, cost-effective and mobilizing tool for public health practice. However, further application and critical review are necessary to make it a more effective public health tool and an established research methodology.
Although evidence-based guidelines are important for improving the quality of patient care, implementation in practice is below expectations. With the recent focus on team care, guidelines are intended to promote the integration of care across multiple disciplines. We conducted an exploratory study to understand oncology nurses' perceptions of guideline implementation and to learn their views on how their experiences affected the implementation.
A qualitative study was used with focus group interviews. We collected data from 11 nurses with more than 5 years of oncology nursing experience in Japan. The data were analyzed using grounded theory.
Results of the analysis identified "preconditions for successful guideline implementation" as a core category. There were 4 categories (goal congruence, equal partnership, professional self-development and user-friendliness) and 11 subcategories related to organizational, multidisciplinary, individual, and guideline levels.
Although the guidelines were viewed as important, they were not fully implemented in practice. There are preconditions at the organizational, multidisciplinary, individual, and guideline levels that must be met if an organization is to successfully implement the guideline in clinical settings. Prioritizing strategies by focusing on these preconditions will help to facilitate successful guideline implementation.
Evidence-based guidelines have the potential to improve healthcare. However, their de-novo-development requires substantial resources – especially for complex conditions, and adaptation may be biased by contextually influenced recommendations in source guidelines. In this paper we describe a new approach to guideline development – the systematic guideline review method (SGR), and its application in the development of an evidence-based guideline for family physicians on chronic heart failure (CHF).
A systematic search for guidelines was carried out. Evidence-based guidelines on CHF management in adults in ambulatory care published in English or German between the years 2000 and 2004 were included. Guidelines on acute or right heart failure were excluded. Eligibility was assessed by two reviewers, methodological quality of selected guidelines was appraised using the AGREE instrument, and a framework of relevant clinical questions for diagnostics and treatment was derived. Data were extracted into evidence tables, systematically compared by means of a consistency analysis and synthesized in a preliminary draft. Most relevant primary sources were re-assessed to verify the cited evidence. Evidence and recommendations were summarized in a draft guideline.
Of 16 included guidelines five were of good quality. A total of 35 recommendations were systematically compared: 25/35 were consistent, 9/35 inconsistent, and 1/35 un-rateable (derived from a single guideline). Of the 25 consistencies, 14 were based on consensus, seven on evidence and four differed in grading. Major inconsistencies were found in 3/9 of the inconsistent recommendations. We re-evaluated the evidence for 17 recommendations (evidence-based, differing evidence levels and minor inconsistencies) – the majority was congruent. Incongruity was found where the stated evidence could not be verified in the cited primary sources, or where the evaluation in the source guidelines focused on treatment benefits and underestimated the risks. The draft guideline was completed in 8.5 man-months. The main limitation to this study was the lack of a second reviewer.
The systematic guideline review including framework development, consistency analysis and validation is an effective, valid, and resource saving-approach to the development of evidence-based guidelines.
Initiatives to raise the quality of care provided to mothers need to be given priority in Sub Saharan Africa (SSA). The promotion of clinical practice guidelines (CPGs) is a common strategy, but their implementation is often challenging, limiting their potential impact. Through a cross-country perspective, this study explored CPGs for maternal health in Burkina Faso, Ghana, and Tanzania. The objectives were to compare factors related to CPG use including their content compared with World Health Organization (WHO) guidelines, their format, and their development processes. Perceptions of their availability and use in practice were also explored. The overall purpose was to further the understanding of how to increase CPGs' potential to improve quality of care for mothers in SSA.
The study was a multiple case study design consisting of cross-country comparisons using document review and key informant interviews. A conceptual framework to aid analysis and discussion of results was developed, including selected domains related to guidelines' implementability and use by health workers in practice in terms of usability, applicability, and adaptability.
The study revealed few significant differences in content between the national guidelines for maternal health and WHO recommendations. There were, however, marked variations in the format of CPGs between the three countries. Apart from the Ghanaian and one of the Tanzanian CPGs, the levels of both usability and applicability were assessed as low or medium. In all three countries, the use of CPGs by health workers in practice was perceived to be limited.
Our cross-country study suggests that it is not poor quality of content or lack of evidence base that constitute the major barrier for CPGs to positively impact on quality improvement in maternal care in SSA. It rather emphasises the need to prioritise the format of guidelines to increase their usability and applicability and to consider these attributes together with implementation strategies as integral to their development processes.
CPGs; Health service delivery; Implementation; Information and communication technology (ICT); Maternal health; Quality improvement; Sub Saharan Africa; WHO
The Guideline Elements Model (GEM) was developed in 2000 to organize the information contained in clinical practice guidelines using XML and to represent guideline content in a form that can be understood by human readers and processed by computers. In this work, we systematically reviewed the literature to better understand how GEM was being used, potential barriers to its use, and suggestions for improvement. Fifty external and twelve internally produced publications were identified and analyzed. GEM was used most commonly for modeling and ontology creation. Other investigators applied GEM for knowledge extraction and data mining, for clinical decision support for guideline generation. The GEM Cutter software—used to markup guidelines for translation into XML— has been downloaded 563 times since 2000. Although many investigators found GEM to be valuable, others critiqued its failure to clarify guideline semantics, difficulties in markup, and the fact that GEM files are not usually executable.
A guideline contains processes and procedures intended to guide health service delivery. However, the presence of guidelines may not guarantee their implementation, which may be a result of weaknesses in the development process. This study was undertaken to describe the processes of developing health planning, services management, and clinical guidelines within the health sector in Uganda, with the goal of understanding how these processes facilitate or abate the utility of guidelines.
Qualitative and quantitative research methods were used to collect and analyze data. Data collection was undertaken at the levels of the central Ministry of Health, the district, and service delivery. Qualitative methods included review of documents, observations, and key informant interviews, as well as quantitative aspects included counting guidelines. Quantitative data were analyzed with Microsoft Excel, and qualitative data were analyzed using deductive content thematic analysis.
There were 137 guidelines in the health sector, with programs related to Millennium Development Goals having the highest number (n = 83). The impetus for guideline development was stated in 78% of cases. Several guidelines duplicated content, and some conflicted with each other. The level of consultation varied, and some guidelines did not consider government-wide policies and circumstances at the service delivery level. Booklets were the main format of presentation, which was not tailored to the service delivery level. There was no framework for systematic dissemination, and target users were defined broadly in most cases. Over 60% of guidelines available at the central level were not available at the service delivery level, but there were good examples in isolated cases. There was no framework for systematic monitoring of use, evaluation, and review of guidelines. Suboptimal performance of the supervision framework that would encourage the use of guidelines, assess their utilization, and provide feedback was noted.
Guideline effectiveness is compromised by the development process. To ensure the production of high-quality guidelines, efforts must be employed at the country and regional levels. The regional level can facilitate pooling resources and expertise in knowledge generation, methodology development, guideline repositories, and capacity building. Countries should establish and enforce systems and guidance on guideline development.
Guidelines; Implementation; Health services; Planning; Management; Uganda
Clinical practice guidelines are important evidence-based resources to guide complex clinical decision making. However, it is challenging for health professionals to keep abreast available guidelines and to know how and where to access relevant guidelines. This review examines currently available guidelines for lung cancer published in the English language. Important key features are listed for each identified guideline. The methodology, approaches to dissemination and implementation, and associated resources are summarised. General challenges in the area of guideline development are highlighted. The potential to collaborate more widely across lung cancer guideline developers by sharing literature searches and assessments is discussed.
Clinical practice guidelines; clinical practice guideline development; evidence-based medicine; lung neoplasms; non-small cell lung carcinoma; small cell lung carcinoma
A number of barriers exist which prevent the widespread integration of practice guidelines with electronic medical record systems. These include dependencies on clinical databases, as well as problems with converting existing guideline specifications into computable rules. We are developing the MBTA (Modeling Better Treatment Advice) practice guideline system which uses a distributed client-server architecture and an object-oriented data representation to support practice guidelines usable by different electronic medical record systems. We describe the structure and organization of MBTA, focusing on how an open systems design, combined with principles of guideline implementation, can be used to provide a general purpose guideline server for use by a variety of clinical workstations.
OBJECTIVE: To recommend effective strategies for implementing clinical practice guidelines (CPGs). DATA SOURCES: The Research and Development Resource Base in Continuing Medical Education, maintained by the University of Toronto, was searched, as was MEDLINE from January 1990 to June 1996, inclusive, with the use of the MeSH heading "practice guidelines" and relevant text words. STUDY SELECTION: Studies of CPG implementation strategies and reviews of such studies were selected. Randomized controlled trials and trials that objectively measured physicians' performance or health care outcomes were emphasized. DATA EXTRACTION: Articles were reviewed to determine the effect of various factors on the adoption of guidelines. DATA SYNTHESIS: The articles showed that CPG dissemination or implementation processes have mixed results. Variables that affect the adoption of guidelines include qualities of the guidelines, characteristics of the health care professional, characteristics of the practice setting, incentives, regulation and patient factors. Specific strategies fell into 2 categories: primary strategies involving mailing or publication of the actual guidelines and secondary interventional strategies to reinforce the guidelines. The interventions were shown to be weak (didactic, traditional continuing medical education and mailings), moderately effective (audit and feedback, especially concurrent, targeted to specific providers and delivered by peers or opinion leaders) and relatively strong (reminder systems, academic detailing and multiple interventions). CONCLUSIONS: The evidence shows serious deficiencies in the adoption of CPGs in practice. Future implementation strategies must overcome this failure through an understanding of the forces and variables influencing practice and through the use of methods that are practice- and community-based rather than didactic.
Clinical guidelines have been shown to improve the quality of medical care and to reduce its costs. However, most guidelines exist in a free-text representation and, without automation, are not sufficiently accessible to clinicians at the point of care. A prerequisite for automated guideline application is a machine-comprehensible representation of the guidelines. In this study, we designed and implemented a scalable architecture to support medical experts and knowledge engineers in specifying and maintaining the procedural and declarative aspects of clinical guideline knowledge, resulting in a machine comprehensible representation. The new framework significantly extends our previous work on the Digital electronic Guidelines Library (DeGeL) The current study designed and implemented a graphical framework for specification of declarative and procedural clinical knowledge, Gesher. We performed three different experiments to evaluate the functionality and usability of the major aspects of the new framework: Specification of procedural clinical knowledge, specification of declarative clinical knowledge, and exploration of a given clinical guideline. The subjects included clinicians and knowledge engineers (overall, 27 participants). The evaluations indicated high levels of completeness and correctness of the guideline specification process by both the clinicians and the knowledge engineers, although the best results, in the case of declarative-knowledge specification, were achieved by teams including a clinician and a knowledge engineer. The usability scores were high as well, although the clinicians’ assessment was significantly lower than the assessment of the knowledge engineers.
Medical informatics; clinical guidelines; decision support systems; knowledge representation; knowledge acquisition; knowledge bases; ontologies; information retrieval; human computer interaction; artificial intelligence; digital libraries; service oriented architecture.
Clinical practice guidelines are one of the foundations of efforts to improve health care. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearing houses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this third paper we discuss the issues of: reviewing, reporting, and publishing guidelines; updating guidelines; and the two emerging issues of enhancing guideline implementability and how guideline developers should approach dealing with the issue of patients who will be the subject of guidelines having co-morbid conditions.
Over the past three decades, the capacity to develop and implement injury surveillance systems (ISS) has grown worldwide and is reflected by the diversity of data gathering environments in which ISS operate. The capacity to evaluate ISS, however, is less advanced and existing evaluation guidelines are ambiguous. Furthermore, the applied relevance of these guidelines to evaluate ISS operating in various settings is unclear. The aim of this paper was to examine how the World Health Organization (WHO) injury surveillance guidelines have been applied to evaluate systems operating in three different contexts.
The attributes of a good surveillance system as well as instructions for conducting evaluations, outlined in the WHO injury surveillance guidelines, were used to develop an analytical framework. Using this framework, a comparative analysis of the application of the guidelines was conducted using; the Aboriginal Community-Centered Injury Surveillance System (ACCISS) from Canada, the Shantou-Emergency Department Injury Surveillance Project (S-EDISP) from China, and the Yorkhill-Canadian Hospitals Injury Reporting and Prevention Program (Y-CHIRPP) imported from Canada and implemented in Scotland.
The WHO guidelines provide only a basic platform for evaluation. The guidelines over emphasize epidemiologic attributes and methods and under emphasize public health and injury prevention perspectives requiring adaptation for context-based relevance. Evaluation elements related to the dissemination and use of knowledge, acceptability, and the sustainability of ISS are notably inadequate. From a public health perspective, alternative reference points are required for re-conceptualizing evaluation paradigms. This paper offers an ISS evaluation template that considers how the WHO guidelines could be adapted and applied.
Findings suggest that attributes of a good surveillance system, when used as evaluation metrics, cannot be weighted equally across ISS. In addition, the attribute of acceptability likely holds more relevance than previously recognized and should be viewed as a critical underpinning attribute of ISS. Context-oriented evaluations sensitive to distinct operational environments are more likely to address knowledge gaps related to; understanding links between the production of injury data and its use, and the effectiveness, impact, and sustainability of ISS. Current frameworks are predisposed to disassociating epidemiologic approaches from subjective factors and social processes.