|Home | About | Journals | Submit | Contact Us | Français|
The online version of this article has been published under an open access model. Users are entitled to use, reproduce, disseminate, or display the open access version of this article for non-commercial purposes provided that: the original authorship is properly and fully attributed; the Journal and Oxford University Press are attributed as the original place of publication with the correct citation details given; if an article is subsequently reproduced or disseminated not in its entirety but only in part or as a derivative work this must be clearly indicated. For commercial re-use, please contact firstname.lastname@example.org
To implement a prescribing-error reporting system in primary care offices and analyze the reports.
Descriptive analysis of a voluntary prescribing-error-reporting system
Seven primary care offices in Vermont, USA.
One hundred and three prescribers, managers, nurses and office staff.
Nurses and office staff were asked to report all communications with community pharmacists regarding prescription problems.
All reports were classified by severity category, setting, error mode, prescription domain and error-producing conditions.
All practices submitted reports, although reporting decreased by 3.6 reports per month (95% CI, −2.7 to −4.4, P < 0.001, by linear regression analysis). Two hundred and sixteen reports were submitted. Nearly 90% (142/165) of errors were severity Category B (errors that did not reach the patient) according to the National Coordinating Council for Medication Error Reporting and Prevention Index for Categorizing Medication Errors. Nineteen errors reached the patient without causing harm (Category C); and 4 errors caused temporary harm requiring intervention (Category E). Errors involving strength were found in 30% of reports, including 23 prescriptions written for strengths not commercially available. Antidepressants, narcotics and antihypertensives were the most frequent drug classes reported. Participants completed an exit survey with a response rate of 84.5% (87/103). Nearly 90% (77/87) of respondents were willing to continue reporting after the study ended, however none of the participants currently submit reports.
Nurses and office staff are a valuable resource for reporting prescribing errors. However, without ongoing reminders, the reporting system is not sustainable.
Recent data suggest over 1.5 million preventable adverse drug events, or injuries due to medications, occur in the United States annually [1, 2]. In outpatients older than 65 years, preventable adverse drug events are estimated to exceed 530 000 annually . Approximately one-third of outpatient adverse drug events may be preventable or ameliorable . Many adverse drug events are the result of undetected medication errors. An error is ‘the failure of a planned action to be completed as intended or the use of a wrong plan to achieve an aim ’. A medication error therefore is ‘any error occurring in the medication use process ’.
Not all medication errors cause injury. A prescribing error occurs when, ‘as a result of a prescribing decision or prescription writing process, there is an unintentional significant (i) reduction in the probability of treatment being timely and effective or (ii) increase in the risk of harm when compared with generally accepted practice ’. Data suggest ~2% of all new prescriptions requires pharmacists to intervene with prescribers to correct or clarify prescriptions before the medication is safely dispensed to a patient [8, 9]. This roughly translates to 60 million pharmacist interventions during the dispensing of 3 billion prescriptions annually in the United States. Many of these pharmacist interventions are to correct prescribing errors, although the exact frequency is not known due to the lack of standards for classifying errors.
Voluntary error reporting has been proposed to help identify and understand medication errors [1, 5], however few studies in primary care (Internal or Family Medicine) have been published. Most of the published reporting systems involve clinician reporting and include all types of medical errors [10–12]. Medication errors are frequently reported in those systems.
The limited literature of primary care error reports suggests a high frequency of medication errors. However, more focused studies are needed to identify and describe the types of medication errors detected. Although collecting errors via self-report is difficult and likely excludes some important errors, voluntary reporting may prove useful in primary care as a basis for quality improvement. We describe a voluntary error-reporting system that was developed and implemented in our local primary care practices. The study targeted prescribing errors, a subset of all medication errors, using existing office systems. The primary reporters were nurses and office staff, since they often receive the communication from the community pharmacy that a problem has occurred.
A voluntary outpatient prescribing-error-reporting system was developed and implemented in a convenience sample of seven primary care (Internal or Family Medicine) practices in Chittenden County, Vermont. Chittenden County occupies 539 square miles of Vermont and is the only county in Vermont federally designated as urban with a population estimate of 150 000. The community has 94.8% white with a median annual income of US$52 843 . The practices reflect the demographics of Vermont primary care, with a median of five prescribers per practice, including physicians, physician assistants or nurse practitioners (range: 2–13 prescribers).
Vermont's Quality Assurance law, 26 V.S.A. Sections 1442 and 1443, provided the necessary liability and confidentiality safeguards for peer-review protections. All participating staff, nurses, managers and prescribers (physicians, nurse practitioners and physician assistants) signed statements of consent. This project was approved by the University of Vermont Committees on Human Research.
Nurses and office staff were asked to report all communications with pharmacists about prescribing problems for 6 months. These two groups of workers were selected as primary reporters because they are often telephoned by community pharmacists when there is a problem with a prescription. Depending on the nature of the problem, the nurses and staff will resolve the problem by reviewing the notes in the medical chart or by communicating with the prescriber. Rarely, the community pharmacist will request to speak to the prescriber directly. Using pharmacist communications as the signal for a potential error is somewhat limited in scope as many medication errors occur outside of this pathway. However, we wished to explore the kinds of insights about prescribing errors that can be revealed using this existing practice within primary care.
Nurses and office staff were asked to report whenever a pharmacist telephoned the practice (i) with a question about a prescription or (ii) to report a problem with a prescription. Although the reporting system was designed to be a job function of the nurses and staff, prescribers were also encouraged to report their own errors. Reports were submitted by telephone, mail or to a research assistant who visited each practice weekly.
We wished to explore the utility of existing office systems serving as error reports. Therefore the nurses and office staff were encouraged to use their usual methods for documenting pharmacist communications as the reports. No standard reporting form was used and there were no incentives to report. None of the practices used electronic medical records. Examples of reporting methods include notes on pre-printed message forms or medication refill forms, copies of de-identified patient chart notes and brief notes written on self-sticking message pads.
At periodic 1-h site visits, we shared data with the practices. The intervals for the site visits were determined by having gathered enough new reports or having completed the 6-month study. Frequent, dangerous or unusual errors were highlighted. A 1-page newsletter prepared by the Principal Investigator described recent de-identified reports submitted by the practice, as well as an overall summary of reports submitted by other practices.
The exit process included a thank you letter, survey and a $1.00 lottery ticket mailed to each participant with a postage-paid return envelope. The purpose of the survey was to gather basic information from participants regarding satisfaction with the reporting system. The survey asked about several aspects of the reporting system we believed were important to satisfaction, including importance, burden, incentives, reminders and feedback. The majority of responses were dichotomous (yes/no) or based on a five-point Likert scale from strongly disagree to strongly agree. We maximized our survey response with additional mailings at 10 and 20 days after the initial letter.
The analytic plan included analysis of the reporting system and analysis of the submitted reports. Analysis of the reporting system included descriptive statistics of the survey results, estimation of reporting rates and linear regression comparing reports submitted over time. We used Microsoft® Excel 2002 (Microsoft Corporation, Redmond, WA) and Stata/SE, version 9.0 (StataCorp LP, College Station, TX) for statistical analyses. P < 0.05 was required for statistical significance.
Analysis of submitted reports included a descriptive classification. We desired a taxonomy that would be simple for prescribers to understand without additional patient safety training. Although several classification systems and taxonomies have been proposed and evaluated [14–20], none of them seemed appropriate for analyzing outpatient prescribing errors. Therefore we classified all prescription reports five ways: (i) severity, (ii) setting, (iii) error mode, (iv) prescription domain and (v) error-producing conditions (environmental, team, individual or task factors that affect performance) . Severity was assigned using the National Coordinating Council for Medication Error Reporting and Prevention (NCC MERP) Index for Categorizing Medication Errors . Likely settings included the provider office, pharmacy or with the patient. Error modes included omission (failure to carry out the necessary steps in the prescription) , commission (failure to prescribe correctly) , no error or indeterminate. Prescription domain included drug, strength, route, dose, formulation etc. Error-producing conditions were grouped by important themes, such as confusion with abbreviations and illegibility.
A pharmacist (AK) and a physician (BL) independently assigned each report a severity category, setting, error mode and prescription domain. Since a goal of the study was to understand what can be learned using existing office systems, only the submitted reports were considered in the analysis. For example, errors were classified as reaching a patient only if the report specifically mentioned the patient being involved. Most reports did not include reasons why errors occurred. There was moderate agreement among AK and BL (kappa 0.552, standard error 0.044, P < 0.001). Categorization discrepancies were resolved through discussion until consensus was reached.
One hundred and three people from five Internal Medicine practices and two Family Medicine practices participated. They included 31 physicians, 8 nurse practitioners, 2 physician assistants, 26 non-prescribing nurses, 10 medical assistants, 20 office staff and 6 non-physician office managers. Data collection occurred from June 2004 through July 2005.
All practices contributed reports. The majority were submitted directly to the research assistant. Only seven reports (3.5%) were contributed by prescribers. Total reports per practice varied from 10 to 62 reports (median 32 reports per practice). Although the intervention was designed to be 6 months, the end date for practices was greater than 6 months due to scheduling difficulties for exit sessions with the practices (median 32 weeks, range 28–44 weeks).
Table 1 describes estimated reporting rates by practice. Total prescriptions written and total pharmacy calls per practice were not collected. On the basis of the United States physician productivity statistics and ambulatory care survey data, it is estimated that the average prescriptions written per visit is 1.7  with an average of 84 visits per week by family physicians and general internists . Combining these estimates yields an average of 146 prescriptions written per week by family and internal medicine physicians. The average rate of pharmacy calls to the office for clarifications is 2% . These averages were used to estimate reporting rates for each of the seven practices, which ranged from 3.1 to 8.6% with a median reporting rate of 6.1%.
Overall reporting statistically decreased by 3.6 reports per month (95% CI, −2.7 to −4.4, P < 0.001). See Fig. 1. After the study end date, only one report was received. None of the practices have continued to submit reports.
The reports described 216 near-misses or errors, 116 unique drugs and 2 non-drug products (lancets and test strips for patients with diabetes). Over 65% (141/216) of the reports identified the medication by trade name rather than generic name. Antidepressants (38/216), narcotics (32/216) and antihypertensives (24/216) were the most frequent drug classes reported. Bupropion was the individual drug most often reported (12/216), followed by levothyroxine (6/216) and metoprolol (6/216). Twenty percent of near-misses or errors (43/216) concerned ‘high-alert’ medications or medications that ‘have a high risk of causing injury when they are misused ’ (Table 2).
Table 3 describes the severity classification of all 216 near-misses or errors according to the National Coordinating Council for Medication Error Reporting and Prevention (NCC MERP) Index for Categorizing Medication Errors. One hundred and sixty-five were errors, 49 were near-misses (Category A) and 2 problems did not contain enough information to determine a severity category. Nearly 90% (142/165) of the errors were Category B, errors that did not reach the patient. Nineteen errors reached the patient without causing harm (C), and four errors caused temporary harm requiring intervention (E). We did not observe any errors in NCC MERP Categories D, F, G, H or I. Examples of reports by category are also presented in Table 3.
Table 4 describes the setting, error mode, prescription domain and error-producing conditions of the submitted reports. The majority of near-misses or errors originated within prescribers' offices. Only 16 near-misses or errors originated within the pharmacy or patient environment. Fifty-five percent of errors were commissions (90/165). The remaining errors (75/165) were omissions. Issues with strength were found in over 30% (66/216) of near-misses or errors, including 23 prescriptions written for strengths not commercially available.
Illegibility was the most frequent error-producing condition. Approximately 45% (22/49) of the near-misses (Category A reports) were reports of ‘illegible handwriting’. Three Category B reports also had evidence of illegibility. Confusion due to look-alike or sound-alike medication names was found in 5% (12/216) of near-misses or errors. Other error-producing conditions included multiple formulations available (11/216), calculations or decimal points (7/216), unusual schedules such as weekly doses or tapers (6/216), confusion due to abbreviations (3/216), use of multiple pharmacies (3/216) or multiple prescribers (2/216) and the availability of multiple drugs within a therapeutic class (5/216). An example of multiple drugs within a therapeutic class is prescribing ‘Actos 4 mg’. The available strengths for Actos (pioglitazone) are 15, 30 and 45 mg. However, the available strengths for Avandia (rosiglitazone), a different drug within the same therapeutic class, are 2, 4 and 8 mg. Since the trade names are similar and both drugs belong to the same therapeutic class, it is possible there was confusion with the correct prescribing information for each drug.
84.5% (87/103) of participants completed the exit survey (Table 5). The survey respondents included 33 prescribers, 24 nurses, 6 medical assistants, 16 office staff and 5 managers. Three respondents did not list their profession. Seventy-eight (68/87) were female and 92% (80/87) were white. Over 90% of respondents stated that the reporting system is important to patient care (77/85) and will improve patient care (76/84). Nearly 60% (60/87) of respondents stated a standard reporting form would have improved the system. Interestingly, respondents were undecided about having more reminders and feedback. Approximately half of respondents agreed or were neutral that more reminders and feedback were needed. Nearly 90% (77/87) were willing to continue participating in the reporting system after the study ended. Only two respondents indicated that the reporting system was burdensome to them and to their office. One respondent was neutral about personal burden, but indicated that the system was burdensome to their office.
We successfully implemented a prescribing-error-reporting system in busy outpatient primary care practices using existing office systems. This approach required minimal provider and staff effort. The system was easily transferable from practice to practice, despite operational differences in handling pharmacist communications. Providers, nurses, office staff and managers overwhelmingly accepted the system, with most willing to continue their involvement. However, none of the practices have continued to send reports.
It is unclear why the reporting system failed to work beyond the study. Although there was disagreement among the survey respondents about the need for more reminders and feedback, it is likely that some intervention is required to keep participants active. Given the decrease in submitted reports over time during the study, it is likely that our reminders and feedback were insufficient to create a sustainable system.
Errors in strength, dosage form  and decimal point or calculations  have been reported in the literature for more than 30 years. Why should these types of errors still be reported? First, reporting is important for local surveillance and education. Our data suggest feedback to providers about prescribing bupropion and strengths not commercially available would be useful for local quality improvement efforts. Second, reporting promotes a discussion of error. Since the majority of reports concerned circumstances or errors that did not reach the patient, prescribers discussed the errors without fear of litigation. Third, reporting is hypothesis-generating for strategies that may then undergo rigorous testing. For example, error reports stimulated us to develop and test a modified prescribing form . Reports may be used to stimulate other ‘basic science’ research into the understudied nature of error . Lastly, reporting can help evaluate new technology after implementation. Although computerized technology is widely promoted as a means of reducing prescribing errors, these systems do not prevent all types of prescribing errors, have induced new errors and have questionable generalizability [32–35]. Reporting systems detect unanticipated errors and can guide revisions of new technology.
The strengths of this reporting system include simple design, outpatient focus, easy translation to multiple primary care offices and minimal disruption of the office. The system allows for local surveillance of prescribing errors, promotes a discussion of errors among prescribers, nurses and office staff, and generates ideas for future research.
The limitations of this study include low reporting rates, inability to capture many important errors, small sample size, geographic restriction to one state and limited follow-up analysis with participants. We did not have patient information or the prescribers' perspectives on the circumstances surrounding the error. A more detailed survey or semi-structured interviews would have enhanced our understanding of the strengths and weaknesses of our system. It is unknown if this system would transfer well to specialty practices. We do not know if any of the practices have made changes or conducted quality improvement projects based on the feedback received from the reporting system. Finally, since none of the practices in this study use electronic prescribing technology, it is unknown if the detected errors would be similar or different.
Nurses and office staff may not have fully understood the complexities of the prescriptions and pharmacology of the medications well enough to submit complete reports. Additionally since the nurses and office staff were often intermediate parties, many of the reports did not contain the resolution of the problem. These limitations are recognized, however there was still interesting and useful information contained in the submitted reports.
As with all voluntary reporting systems, the true error rate is unknown, the ability to capture important errors is unpredictable and the reporting rates are consistently low. We only have data that participants deemed ‘reportable’. For example, participants may have felt a heightened awareness around narcotics compared with other classes of drugs, contributing to higher reporting. However, errors involving another class of drugs may have been more frequent or more dangerous. Additionally many medication errors, such as administration errors or errors corrected with the patient at the pharmacy before dispensing are not detected by this system and are therefore never reported.
These data are not rich enough to further specify errors mechanisms. For example, one report described a prescription for 120 tablets of oxycodone, but the pharmacist dispensed 180 tablets. With more data, we may be able to determine if this error was a substitution of 180 for 120 or a repetition of a count of 60. This insight is important as different solutions are required depending on the mechanism of the error.
Nurses and office staff are a valuable resource for reporting prescribing errors in primary care practices. However, without ongoing reminders, the reporting system is not sustainable. Important information about outpatient prescribing errors is available using existing office systems. Simple taxonomies for outpatient prescription errors may be useful to primary care practices who wish to conduct local quality improvement efforts, although further study is required to explore the effectiveness of these efforts and applicability to practices with electronic prescribing systems.
The authors wish to thank all of the participants in this study for their time so that we all may learn more about prescribing errors. This work was supported by funding from grant number 1 K08 HS013891 from the Agency for Healthcare Research and Quality.