Related Articles

Background

Evidence Based Medicine (EBM) practice requires practitioners to extract evidence from published medical research when answering clinical queries. Due to the time- consuming nature of this practice, there is a strong motivation for systems that can automatically summarise medical documents and help practitioners find relevant information.

Aim

The aim of this work is to propose an automatic query- focused, extractive summarisation approach that selects informative sentences from medical documents.

Method

We use a corpus that is specifically designed for summarisation in the EBM domain. We use approximately half the corpus for deriving important statistics associated with the best possible extractive summaries. We take into account factors such as sentence position, length, sentence content, and the type of the query posed. Using the statistics from the first set, we evaluate our approach on a separate set. Evaluation of the qualities of the generated summaries is performed automatically using ROUGE, which is a popular tool for evaluating automatic summaries.

Results

Our summarisation approach outperforms all baselines (best baseline score: 0.1594; our score 0.1653). Further improvements are achieved when query types are taken into account.

Conclusion

The quality of extractive summarisation in the medical domain can be significantly improved by incorporating domain knowledge and statistics derived from a specialised corpus. Such techniques can therefore be applied for content selection in end-to-end summarisation systems.

Objective:

The research sought to establish a rubric for evaluating evidence-based medicine (EBM) point-of-care tools in a health sciences library.

Methods:

The authors searched the literature for EBM tool evaluations and found that most previous reviews were designed to evaluate the ability of an EBM tool to answer a clinical question. The researchers' goal was to develop and complete rubrics for assessing these tools based on criteria for a general evaluation of tools (reviewing content, search options, quality control, and grading) and criteria for an evaluation of clinical summaries (searching tools for treatments of common diagnoses and evaluating summaries for quality control).

Results:

Differences between EBM tools' options, content coverage, and usability were minimal. However, the products' methods for locating and grading evidence varied widely in transparency and process.

Conclusions:

As EBM tools are constantly updating and evolving, evaluation of these tools needs to be conducted frequently. Standards for evaluating EBM tools need to be established, with one method being the use of objective rubrics. In addition, EBM tools need to provide more information about authorship, reviewers, methods for evidence collection, and grading system employed.

Objectives

Healthcare institutions need timely patient information from various sources at the point-of-care. Evidence-based medicine (EBM) is a tool for proper and efficient incorporation of the results of research in decision-making. Characteristics of medical treatment processes and practical experience concerning the effect of EBM in the clinical process are surveyed.

Methods

A cross sectional survey conducted in Tehran hospitals in February-March 2012 among 51 clinical residents. The respondents were asked to apply EBM in clinical decision-making to answer questions about the effect of EBM in the clinical process. A valid and reliable questionnaire was used in this study.

Results

EBM provides a framework for problem solving and improvement of processes. Most residents (76%) agreed that EBM could improve clinical decision making. Eighty one percent of the respondents believed that EBM resulted in quick updating of knowledge. They believed that EBM was more useful for diagnosis than for treatment. There was a significant association between out-patients and in-patients in using electronic EBM resources.

Conclusions

Research findings were useful in clinical practice and decision making. The computerized guidelines are important tools for improving clinical process quality. When learning how to use IT, methods of search and evaluation of evidence for diagnosis, treatment and medical education are necessary. Purposeful use of IT in clinical processes reduces workload and improves decision-making.

Objective

To answer five research questions: Do Norwegian physicians know about the three important aspects of EBM? Do they use EBM methods in their clinical practice? What are their attitudes towards EBM? Has EBM in their opinion changed medical practice during the last 10 years? Do they use EBM based information sources?

Design

Cross sectional survey in 2006.

Setting

Norway.

Participants

966 doctors who responded to a questionnaire (70% response rate).

Results

In total 87% of the physicians mentioned the use of randomised clinical trials as a key aspect of EBM, while 53% of them mentioned use of clinical expertise and only 19% patients' values. 40% of the respondents reported that their practice had always been evidence-based. Many respondents experienced difficulties in using EBM principles in their clinical practice because of lack of time and difficulties in searching EBM based literature. 80% agreed that EBM helps physicians towards better practice and 52% that it improves patients' health. As reasons for changes in medical practice 86% of respondents mentioned medical progress, but only 39% EBM.

Conclusions

The results of the study indicate that Norwegian physicians have a limited knowledge of the key aspects of EBM but a positive attitude towards the concept. They had limited experience in the practice of EBM and were rather indifferent to the impact of EBM on medical practice. For solving a patient problem, physicians would rather consult a colleague than searching evidence based resources such as the Cochrane Library.

Summary

Evidence-based medicine (EBM) is an indispensable tool in clinical practice. Teaching and training of EBM to trainee clinicians is patchy and fragmented at its best. Clinically integrated teaching of EBM is more likely to bring about changes in skills, attitudes and behaviour. Provision of evidence-based health care is the most ethical way to practice, as it integrates up-to-date, patient-oriented research into the clinical decision making process, thus improving patients' outcomes. In this article, we aim to dispel the myth that EBM is an academic and statistical exercise removed from practice by providing practical tips for teaching the minimum skills required to ask questions and critically identify and appraise the evidence and presenting an approach to teaching EBM within the existing clinical and educational training infrastructure.

Objectives:

Constructing an answerable question and effectively searching the medical literature are key steps in practicing evidence-based medicine (EBM). This study aimed to identify the effectiveness of delivering a single workshop in EBM literature searching skills to medical students entering their first clinical years of study.

Methods:

A randomized controlled trial was conducted with third-year undergraduate medical students. Participants were randomized to participate in a formal workshop in EBM literature searching skills, with EBM literature searching skills and perceived competency in EBM measured at one-week post-intervention via the Fresno tool and Clinical Effectiveness and Evidence-Based Practice Questionnaire.

Results:

A total of 121 participants were enrolled in the study, with 97 followed-up post-intervention. There was no statistical mean difference in EBM literature searching skills between the 2 groups (mean difference = 0.007 (P = 0.99)). Students attending the EBM workshop were significantly more confident in their ability to construct clinical questions and had greater perceived awareness of information resources.

Conclusions:

A single EBM workshop did not result in statistically significant changes in literature searching skills. Teaching and reinforcing EBM literature searching skills during both preclinical and clinical years may result in increased student confidence, which may facilitate student use of EBM skills as future clinicians.

Evidence-Based Medicine (EBM) has become a popular approach to medical decision making and is increasingly part of undergraduate and postgraduate medical education. EBM follows four steps: 1. formulate a clear clinical question from a patient’s problem; 2. search the literature for relevant clinical articles; 3. evaluate (critically appraise) the evidence for its validity and usefulness; 4. implement useful findings into clinical practice. This review describes the concepts, terminology and skills taught to attendees at EBM courses, focusing specifically on the approach taken to diagnostic questions. It covers how to ask an answerable clinical question, search for evidence, construct diagnostic critically appraised topics (CATs), and use sensitivity, specificity, likelihood ratios, kappa and phi statistics. It familiarises readers with the lexicon and techniques of EBM and allows better understanding of the needs of EBM practitioners.

Aim

To assess awareness and use of evidence-based medicine (EBM) databases and The Cochrane Library among physicians in Croatia.

Methods

A cross-sectional study with a telephone survey was performed among 573 physicians (88.6% response rate from 647 contacted physicians) from family practice and 4 major university hospital centers in Croatia. The main outcome measures were physicians' awareness of The Cochrane Collaboration, awareness and use of The Cochrane Library, access to EBM databases, and access to internet at work.

Results

Overall, 54% of respondents said they had access to EBM databases, but when asked which databases they used, they named mostly non-EBM databases. The question on the highest level of evidence in EBM was correctly answered by 53% respondents, 30% heard of The Cochrane Collaboration, and 34% heard about The Cochrane Library. They obtained information about The Cochrane Library mostly from colleagues and research articles, whereas the information about EBM was gained mainly during continuous medical education. There were more respondents who thought The Cochrane Library could help them in practice (58%) than those who heard about The Cochrane Library (30%). Only 20% of the respondents heard about the initiative for the establishment of the Croatian branch of The Cochrane Collaboration. Family physicians had significantly lower level of awareness, knowledge, and use of EBM and The Cochrane Library than physicians from university hospitals.

Conclusion

There is low awareness about EBM and The Cochrane Library among physicians in Croatia, which creates a need for educational interventions about EBM for the benefit of health care in Croatia.

Background

The term "evidence-based medicine" (or EBM) was introduced about ten years ago, and there has been considerable debate about the value of EBM. However, this debate has sometimes been obscured by a lack of conceptual clarity concerning the nature and status of EBM.

Discussion

First, we note that EBM proponents have obscured the current debate by defining EBM in an overly broad, indeed almost vacuous, manner; we offer a clearer account of EBM and its relation to the alternative approaches to medicine. Second, while EBM proponents commonly cite the philosophical work of Thomas Kuhn and claim that EBM is a Kuhnian 'paradigm shift,' we argue that such claims are seriously mistaken and unduly polarize the EBM debate. Third, we suggest that it is much more fruitful to understand the relationship between EBM and its alternatives in light of a different philosophical metaphor: W.V. Quine's metaphor of the web of belief. Seen in this way, we argue that EBM is an approach to medical practice that is indeed importantly different from the alternatives.

Summary

We can have a more productive debate about the value of EBM by being clearer about the nature of EBM and its relationship to alternative approaches to medicine.

As the name suggests, evidence-based medicine (EBM), is about finding evidence and using that evidence to make clinical decisions. A cornerstone of EBM is the hierarchical system of classifying evidence. This hierarchy is known as the levels of evidence. Physicians are encouraged to find the highest level of evidence to answer clinical questions. Several papers published in Plastic Surgery journals concerning EBM topics have touched on this subject.1–6 Specifically, previous papers have discussed the lack of higher level evidence in PRS and need to improve the evidence published in the journal. Before that can be accomplished, it is important to understand the history behind the levels and how they should be interpreted. This paper will focus on the origin of levels of evidence, their relevance to the EBM movement and the implications for the field of plastic surgery as well as the everyday practice of plastic surgery.

Background

Teaching of evidence-based medicine (EBM) has become widespread in medical education. Teaching the teachers (TTT) courses address the increased teaching demand and the need to improve effectiveness of EBM teaching. We conducted a systematic review of assessment tools for EBM TTT courses. To summarise and appraise existing assessment methods for teaching the teachers courses in EBM by a systematic review.

Methods

We searched PubMed, BioMed, EmBase, Cochrane and Eric databases without language restrictions and included articles that assessed its participants. Study selection and data extraction were conducted independently by two reviewers.

Results

Of 1230 potentially relevant studies, five papers met the selection criteria. There were no specific assessment tools for evaluating effectiveness of EBM TTT courses. Some of the material available might be useful in initiating the development of such an assessment tool.

Conclusion

There is a need for the development of educationally sound assessment tools for teaching the teachers courses in EBM, without which it would be impossible to ascertain if such courses have the desired effect.

Background

In 1992, Evidence-Based Medicine advocates proclaimed a "new paradigm", in which evidence from health care research is the best basis for decisions for individual patients and health systems. Hailed in New York Times Magazine in 2001 as one of the most influential ideas of the year, this approach was initially and provocatively pitted against the traditional teaching of medicine, in which the key elements of knowing for clinical purposes are understanding of basic pathophysiologic mechanisms of disease coupled with clinical experience. This paper reviews the origins, aspirations, philosophical limitations, and practical challenges of evidence-based medicine.

Discussion

EBM has long since evolved beyond its initial (mis)conception, that EBM might replace traditional medicine. EBM is now attempting to augment rather than replace individual clinical experience and understanding of basic disease mechanisms. EBM must continue to evolve, however, to address a number of issues including scientific underpinnings, moral stance and consequences, and practical matters of dissemination and application. For example, accelerating the transfer of research findings into clinical practice is often based on incomplete evidence from selected groups of people, who experience a marginal benefit from an expensive technology, raising issues of the generalizability of the findings, and increasing problems with how many and who can afford the new innovations in care.

Summary

Advocates of evidence-based medicine want clinicians and consumers to pay attention to the best findings from health care research that are both valid and ready for clinical application. Much remains to be done to reach this goal.

Background

Evidence-Based Medicine (EBM) is an important competency for the healthcare professional. Experimental evidence of EBM educational interventions from rigorous research studies is limited. The main objective of this study was to assess EBM learning (knowledge, attitudes and self-reported skills) in undergraduate medical students with a randomized controlled trial.

Methods

The educational intervention was a one-semester EBM course in the 5th year of a public medical school in Mexico. The study design was an experimental parallel group randomized controlled trial for the main outcome measures in the 5th year class (M5 EBM vs. M5 non-EBM groups), and quasi-experimental with static-groups comparisons for the 4th year (M4, not yet exposed) and 6th year (M6, exposed 6 months to a year earlier) groups. EBM attitudes, knowledge and self-reported skills were measured using Taylor’s questionnaire and a summative exam which comprised of a 100-item multiple-choice question (MCQ) test.

Results

289 Medical students were assessed: M5 EBM=48, M5 non-EBM=47, M4=87, and M6=107. There was a higher reported use of the Cochrane Library and secondary journals in the intervention group (M5 vs. M5 non-EBM). Critical appraisal skills and attitude scores were higher in the intervention group (M5) and in the group of students exposed to EBM instruction during the previous year (M6). The knowledge level was higher after the intervention in the M5 EBM group compared to the M5 non-EBM group (p<0.001, Cohen's d=0.88 with Taylor's instrument and 3.54 with the 100-item MCQ test). M6 Students that received the intervention in the previous year had a knowledge score higher than the M4 and M5 non-EBM groups, but lower than the M5 EBM group.

Conclusions

Formal medical student training in EBM produced higher scores in attitudes, knowledge and self-reported critical appraisal skills compared with a randomized control group. Data from the concurrent groups add validity evidence to the study, but rigorous follow-up needs to be done to document retention of EBM abilities.

Background

The Accreditation Council for Graduate Medical Education (ACGME) invokes evidence-based medicine (EBM) principles through the practice-based learning core competency. The authors hypothesized that among a representative sample of emergency medicine (EM) residency programs, a wide variability in EBM resident training priorities, faculty expertise expectations, and curricula exists.

Objectives

The primary objective was to obtain descriptive data regarding EBM practices and expectations from EM physician educators. Our secondary objective was to assess differences in EBM educational priorities among journal club directors compared with non–journal club directors.

Methods

A 19-question survey was developed by a group of recognized EBM curriculum innovators and then disseminated to Council of Emergency Medicine Residency Directors (CORD) conference participants, assessing their opinions regarding essential EBM skill sets and EBM curricular expectations for residents and faculty at their home institutions. The survey instrument also identified the degree of interest respondents had in receiving a free monthly EBM journal club curriculum.

Results

A total of 157 individuals registered for the conference, and 98 completed the survey. Seventy-seven (77% of respondents) were either residency program directors or assistant / associate program directors. The majority of participants were from university-based programs and in practice at least 5 years. Respondents reported the ability to identify flawed research (45%), apply research findings to patient care (43%), and comprehend research methodology (33%) as the most important resident skill sets. The majority of respondents reported no formal journal club or EBM curricula (75%) and do not utilize structured critical appraisal instruments (71%) when reviewing the literature. While journal club directors believed that resident learners’ most important EBM skill is to identify secondary peer-reviewed resources, non–journal club directors identified residents’ ability to distinguish significantly flawed research as the key skill to develop. Interest in receiving a free monthly EBM journal club curriculum was widely accepted (89%).

Conclusions

Attaining EBM proficiency is an expected outcome of graduate medical education (GME) training, although the specific domains of anticipated expertise differ between faculty and residents. Few respondents currently use a formalized curriculum to guide the development of EBM skill sets. There appears to be a high level of interest in obtaining EBM journal club educational content in a structured format. Measuring the effects of providing journal club curriculum content in conjunction with other EBM interventions may warrant further investigation.

Background

While previous authors have emphasized the importance of integrating and reinforcing evidence-based medicine (EBM) skills in residency, there are few published examples of such curricula. We designed an EBM curriculum to train family practice interns in essential EBM skills for information mastery using clinical questions generated by the family practice inpatient service. We sought to evaluate the impact of this curriculum on interns, residents, and faculty.

Methods

Interns (n = 13) were asked to self-assess their level of confidence in basic EBM skills before and after their 2-week EBM rotation. Residents (n = 21) and faculty (n = 12) were asked to assess how often the answers provided by the EBM intern to the inpatient service changed medical care. In addition, residents were asked to report how often they used their EBM skills and how often EBM concepts and tools were used in teaching by senior residents and faculty. Faculty were asked if the EBM curriculum had increased their use of EBM in practice and in teaching.

Results

Interns significantly increased their confidence over the course of the rotation. Residents and faculty felt that the answers provided by the EBM intern provided useful information and led to changes in patient care. Faculty reported incorporating EBM into their teaching (92%) and practice (75%). Residents reported applying the EBM skills they learned to patient care (86%) and that these skills were reinforced in the teaching they received outside of the rotation (81%). All residents and 11 of 12 faculty felt that the EBM curriculum had improved patient care.

Conclusions

To our knowledge, this is the first published EBM curriculum using an individual block rotation format. As such, it may provide an alternative model for teaching and incorporating EBM into a residency program.

This article describes the judgements used to interpret evidence in evidence-based medicine (EBM) and health technology assessment (HTA). It outlines the methods and processes of EBM and HTA. Respectively, EBM and HTA are approaches to medical clinical decision making and efficient allocation of scarce health resources. At the heart of both is a concern to review and synthesise evidence, especially evidence derived from randomised controlled trials (RCTs) of clinical effectiveness. The driver of the approach of both is a desire to eliminate, or at least reduce, bias. The hierarchy of evidence, which is used as an indicator of the likelihood of bias, features heavily in the process and methods of EBM and HTA. The epistemological underpinnings of EBM and HTA are explored with particular reference to the distinction between rationalism and empiricism, developed by the philosopher David Hume and elaborated by Immanuel Kant in the Critique of Pure Reason. The importance of Humian and Kantian principles for understanding the projects of EBM and HTA is considered and the ways in which decisions are made in both, within a judgemental framework originally outlined by Kant, are explored.

Background

The increasing availability of full-text biomedical articles will allow more biomedical knowledge to be extracted automatically with greater reliability. However, most Information Retrieval (IR) and Extraction (IE) tools currently process only abstracts. The lack of corpora has limited the development of tools that are capable of exploiting the knowledge in full-text articles. As a result, there has been little investigation into the advantages of full-text document structure, and the challenges developers will face in processing full-text articles.

Results

We manually annotated passages from full-text articles that describe interactions summarised in a Molecular Interaction Map (MIM). Our corpus tracks the process of identifying facts to form the MIM summaries and captures any factual dependencies that must be resolved to extract the fact completely. For example, a fact in the results section may require a synonym defined in the introduction. The passages are also annotated with negated and coreference expressions that must be resolved.

We describe the guidelines for identifying relevant passages and possible dependencies. The corpus includes 2162 sentences from 78 full-text articles. Our corpus analysis demonstrates the necessity of full-text processing; identifies the article sections where interactions are most commonly stated; and quantifies the proportion of interaction statements requiring coherent dependencies. Further, it allows us to report on the relative importance of identifying synonyms and resolving negated expressions. We also experiment with an oracle sentence retrieval system using the corpus as a gold-standard evaluation set.

Conclusion

We introduce the MIM corpus, a unique resource that maps interaction facts in a MIM to annotated passages within full-text articles. It is an invaluable case study providing guidance to developers of biomedical IR and IE systems, and can be used as a gold-standard evaluation set for full-text IR tasks.

Knowledge gained in studies of genetic disorders is reported in a growing body of biomedical literature containing reports of genetic variation in individuals that map to medical conditions and/or response to therapy. These scientific discoveries need to be translated into practical applications to optimize patient care. Translating research into practice can be facilitated by supplying clinicians with research evidence. We assessed the role of existing tools in extracting answers to translational research questions in the area of genomic medicine. We: evaluate the coverage of translational research terms in the Unified Medical Language Systems (UMLS) Metathesaurus; determine where answers are most often found in full-text articles; and determine common answer patterns. Findings suggest that we will be able to leverage the UMLS in development of natural language processing algorithms for automated extraction of answers to translational research questions from biomedical text in the area of genomic medicine.

Knowledge gained in studies of genetic disorders is reported in a growing body of biomedical literature containing reports of genetic variation in individuals that map to medical conditions and/or response to therapy. These scientific discoveries need to be translated into practical applications to optimize patient care. Translating research into practice can be facilitated by supplying clinicians with research evidence. We assessed the role of existing tools in extracting answers to translational research questions in the area of genomic medicine. We: evaluate the coverage of translational research terms in the Unified Medical Language Systems (UMLS) Metathesaurus; determine where answers are most often found in full-text articles; and determine common answer patterns. Findings suggest that we will be able to leverage the UMLS in development of natural language processing algorithms for automated extraction of answers to translational research questions from biomedical text in the area of genomic medicine.

Evidence-based Medicine (EBM) has been increasingly integrated into medical education curricula. Using an observational research design, we evaluated the feasibility of introducing a 1-month problem-based EBM course for 139 first-year medical students at a large university center. We assessed program performance through the use of a web-based curricular component and practice exam, final examination scores, student satisfaction surveys, and a faculty questionnaire. Students demonstrated active involvement in learning EBM and ability to use EBM principles. Facilitators felt that students performed well and compared favorably with residents whom they had supervised in the past year. Both faculty and students were satisfied with the EBM course. To our knowledge, this is the first report to demonstrate that early introduction of EBM principles as a short course to preclinical medical students is feasible and practical.

Rationale, aims and objectives

Efforts to implement evidence-based medicine (EBM) training in developing countries are limited. We describe the results of an international effort to improve research capacity in a developing country; we conducted a course aimed at improving basic EBM attitudes and identified challenges.

Method

Between 2005 and 2009, we conducted an annual 3-day course in Perú consisting of interactive lectures and case-based workshops. We assessed self-reported competence and importance in EBM using a Likert scale (1 = low, 5 = high).

Results

Totally 220 clinicians participated. For phase I (2005–2007), self-reported EBM competence increased from a median of 2 to 3 (P < 0.001) and the perceived importance of EBM did not change (median = 5). For phase II (2008–2009), before the course, 8–72% graded their competence very low (score of 1–2). After the course, 67–92% of subjects graded their increase in knowledge very high (score of 4–5). The challenges included limited availability of studies relevant to the local reality written in Spanish, participants’ limited time and lack of long-term follow-up on practice change. Informal discussion and written evaluation from participants were universally in agreement that more training in EBM is needed.

Conclusions

In an EBM course in a resource-poor country, the baseline self-reported competence and experience on EBM were low, and the course had measurable improvements of self-reported competence, perceived utility and readiness to incorporate EBM into their practices. Similar to developed countries, translational research and building the research capacity in developing countries is critical for translating best available evidence into practice.

Background

Few studies have examined residents' retained knowledge and confidence regarding essential evidence-based medicine (EBM) topics.

Objective

To compare postgraduate year-3 (PGY-3) residents' confidence with EBM topics taught during internship with that of PGY-1 residents before and after exposure to an EBM curriculum.

Methods

All residents participated in an EBM curriculum during their intern year. We surveyed residents in 2009. PGY-1 residents completed a Likert-scale type survey (which included questions from the validated Berlin questionnaire and others, developed based on input from local EBM experts). We administered the Berlin questionnaire to a subset of PGY-3 residents.

Results

Forty-five PGY-3 (88%; n  =  51) and 42 PGY-1 (91%; n  =  46) residents completed the survey. Compared with PGY-1 residents pre-curriculum, PGY-3 residents were significantly more confident in their knowledge of pre- and posttest probability (mean difference, 1.14; P  =  .002), number needed to harm (mean difference, 1.09; P  =  .002), likelihood ratio (mean difference, 1.01; P  =  .003), formulation of a focused clinical question (mean difference, 0.98; P  =  .001), and critical appraisal of therapy articles (mean difference, 0.91; P  =  .002). Perceived confidence was significantly lower for PGY-3 than post-curriculum PGY-1 residents on relative risk (mean difference, −0.86; P  =  .002), study design for prognosis questions (mean difference, −0.75; P  =  .004), number needed to harm (mean difference, −0.67; P  =  .01), ability to critically appraise systematic reviews (mean difference, −0.65, P  =  .009), and retrieval of evidence (mean difference, −0.56; P  =  .008), among others. There was no relationship between confidence with and actual knowledge of EBM topics.

Conclusions

Our findings demonstrate lower confidence among PGY-3 than among PGY-1 internal medicine residents for several EBM topics. PGY-3 residents demonstrated poor knowledge of several core topics taught during internship. Longitudinal EBM curricula throughout residency 5 help reinforce residents' EBM knowledge and their confidence.

Background

Incorporating evidence based medicine (EBM) into clinical practice requires clinicians to learn to efficiently gain access to clinical evidence and effectively appraise its validity. Even using current electronic systems, selecting literature-based data to solve a single patient-related problem can require more time than practicing physicians or residents can spare. Clinical librarians, as informationists, are uniquely suited to assist physicians in this endeavor.

Results

To improve support for evidence-based practice, we have developed a web-based EBM library consult service application (LCS). Librarians use the LCS system to provide full text evidence-based literature with critical appraisal in response to a clinical question asked by a remote physician. LCS uses an entirely Free/Open Source Software platform and will be released under a Free Software license. In the first year of the LCS project, the software was successfully developed and a reference implementation put into active use. Two years of evaluation of the clinical, educational, and attitudinal impact on physician-users and librarian staff are underway, and expected to lead to refinement and wide dissemination of the system.

Conclusion

A web-based EBM library consult model may provide a useful way for informationists to assist clinicians, and is feasible to implement.

Objective

To describe the development and assessment of monographs as an assignment to incorporate evidence-based medicine (EBM) and pharmacoeconomic principles into a third-year pharmacoeconomic course.

Design

Eight newly FDA-approved drugs were assigned to 16 teams of students, where each drug was assigned to 2 teams. Teams had to research their drug, write a professional monograph, deliver an oral presentation, and answer questions posed by faculty judges. One team was asked to present evidence for inclusion of the drug into a formulary, while another team presented evidence against inclusion.

Assessment

The teams' average score on the written report was 99.1%; on the oral presentation, 92.5%, and on the online quiz given at the end of the presentations, 77%.

Conclusions

Monographs are a successful method of incorporating and integrating learning across different concepts, as well as increasing relevance of pharmacoeconomics in the PharmD curriculum.

Background

A variety of methods exists for teaching and learning evidence-based medicine (EBM). However, there is much debate about the effectiveness of various EBM teaching and learning activities, resulting in a lack of consensus as to what methods constitute the best educational practice. There is a need for a clear hierarchy of educational activities to effectively impart and acquire competence in EBM skills. This paper develops such a hierarchy based on current empirical and theoretical evidence.

Discussion

EBM requires that health care decisions be based on the best available valid and relevant evidence. To achieve this, teachers delivering EBM curricula need to inculcate amongst learners the skills to gain, assess, apply, integrate and communicate new knowledge in clinical decision-making. Empirical and theoretical evidence suggests that there is a hierarchy of teaching and learning activities in terms of their educational effectiveness: Level 1, interactive and clinically integrated activities; Level 2(a), interactive but classroom based activities; Level 2(b), didactic but clinically integrated activities; and Level 3, didactic, classroom or standalone teaching.

Summary

All health care professionals need to understand and implement the principles of EBM to improve care of their patients. Interactive and clinically integrated teaching and learning activities provide the basis for the best educational practice in this field.