Prescription Errors and Outcomes Related to Inconsistent Information Transmitted through Computerized Order-Entry: A Prospective Study

doi:10.1001/archinternmed.2009.102

Arch Intern Med. Author manuscript; available in PMC 2010 August 10.

Published in final edited form as:

Arch Intern Med. 2009 May 25; 169(10): 982–989.

doi: 10.1001/archinternmed.2009.102

PMCID: PMC2919338

NIHMSID: NIHMS131429

Prescription Errors and Outcomes Related to Inconsistent Information Transmitted through Computerized Order-Entry: A Prospective Study

Hardeep Singh, MD, MPH,¹ Shrinidi Mani,² Donna Espadas, BS,² Nancy Petersen, PhD,² Veronica Franklin, R.Ph.,³ and Laura A. Petersen, MD, MPH¹

¹ Health Policy and Quality Program, Houston VA HSR&D Center of Excellence, and The Center of Inquiry to Improve Outpatient Safety Through Effective Electronic Communication, both at the Michael E. DeBakey Veterans Affairs Medical Center and the Section of Health Services Research, Department of Medicine, Baylor College of Medicine, Houston, Texas

² Houston VA HSR&D Center of Excellence, and The Center of Inquiry to Improve Outpatient Safety Through Effective Electronic Communication, both at the Michael E. DeBakey Veterans Affairs Medical Center

³ Section of Pharmacy, Michael E. DeBakey Veterans Affairs Medical Center Houston, Texas

Address for Correspondence and Reprints: Hardeep Singh, MD, MPH, VA Medical Center (152), 2002 Holcombe Blvd, Houston, TX 77030, Phone (713) 794-8515, Email: hardeeps/at/bcm.tmc.edu, Fax: 713-748-7359

The publisher's final edited version of this article is available at Arch Intern Med

See other articles in PMC that cite the published article.

Abstract

Background

Although several types of computerized provider order entry (CPOE)-related errors may occur, errors related to inconsistent information within the same prescription (ie, mismatch between the structured template and the associated free-text field) have not been described, to our knowledge. We determined the nature and frequency of such errors and identified their potential predictive variables.

Methods

In this prospective study, we enrolled pharmacists to report prescriptions containing inconsistent communication over a 4-month period at a tertiary care facility. We also electronically retrieved all prescriptions written during the study period containing any comments in the free-text field and then randomly selected 500 for manual review to determine inconsistencies between free-text and structured fields. Of these, prescriptions without inconsistencies were categorized as controls. Data on potentially predictive variables from reported and unreported errors and controls were collected. For all inconsistencies, we determined their nature (eg, drug dosage or administration schedule) and potential harm and used multivariate logistic regression models to identify factors associated with errors and harm.

Results

Of 55 992 new prescriptions, 532 (0.95%) were reported to contain inconsistent communication, a rate comparable to that obtained from the unreported group. Drug dosage was the most common inconsistent element among both groups. Certain medications were more likely associated with errors, as was the inpatient setting (odds ratio, 3.30; 95% confidence interval, 2.18–5.00) and surgical subspecialty (odds ratio, 2.45; 95% confidence interval, 1.57–3.82). About 20% of errors could have resulted in moderate to severe harm, for which significant independent predictors were found.

Conclusions

Despite standardization of data entry, inconsistent communication in CPOE poses a significant risk to safety. Improving the usability of the CPOE interface and integrating it with workflow may reduce this risk.

BACKGROUND

Several studies have found that computerized physician order entry (CPOE) systems reduce medication errors and overall patient harm.¹^–⁴ However, computerization may introduce new error pathways.⁵^–¹⁰ Errors facilitated by CPOE have received increasing attention in the literature, yet the true frequency of the problem is unknown.⁹^,¹¹^,¹² Most medication errors are related to the ordering process,¹³ and many types of CPOE-related errors have been described in recent years.⁵^–¹⁰ For instance, a study using both qualitative and quantitative methods to study house staff interaction with a CPOE system at a tertiary care facility identified 22 different types of medication errors, including fragmented CPOE displays and inflexible ordering formats.⁹

To our knowledge, order entry errors related to inconsistent information within the same prescription have not been described. For instance, even though CPOE standardizes details of order entry through use of structured templates, clarifications or nonstandard specifications may still be entered through a free-text comment field. Narrative instructions in the free-text field have advantages in highly structured order entry forms¹⁴ because they allow flexibility for providers to enter clarifications regarding timing, dosage, or route of administration. The flexibility, however, can lead to discrepancies between the elements selected through the structured template and the provider’s free-text comments (Figure 1). For example inconsistent communication occurs when the provider selects “Warfarin 10mg orally every day” through the template but in the comment field writes “Take 7.5mg a day on Monday-Friday only.” Because poor communication is an often-cited preventable factor in adverse events,¹⁵ it warrants further characterization of inconsistencies. While the pharmacist may know how to resolve the inconsistency, the free-text comments are printed on the label of the dispensed medication, which may confuse or harm the patient.

Figure 1

A screenshot of the computerized provider order entry interface showing structured entry and free-text window.

In our study, we analyzed an advanced CPOE system for inconsistent communication, which we defined as occurring when there was discordance between information entered through the structured template and the free-text comment field. Our objectives were to (1) describe errors and potential harm of inconsistent communication occurring within prescriptions entered through an advanced CPOE system; and (2) identify predictive variables associated with inconsistent communication and potential harm in an advanced CPOE so as to identify safety improvements. This project serves as a model for safety and usability enhancement in advanced CPOE systems.

Methods

The study was conducted at the Michael E. DeBakey Veterans Affairs Medical Center (MEDVAMC) in Houston, Texas, and approved by the local institutional review board and the MEDVAMC research and development committee. We prospectively evaluated prescriptions written between October 1, 2007, and January 31, 2008, for inconsistent communication using 2 methods: stimulated pharmacy reporting and electronic searches for prescriptions with comments followed by random reviews. Since 1998, MEDVAMC has used CPOE, which is integrated with the Computerized Patient Record System, part of the larger Veterans Information System Technology Architecture. Each facility can customize the CPOE locally to a limited extent, but the overall development and maintenance is carried out nationally. Clinical decision support including checking for allergies, drug-drug interactions, dosing, and price information is available. New providers receive CPOE training, and additional information is available through an institutional Web page. All orders are entered exclusively through CPOE by resident physician trainees, staff physicians, and other allied health providers in inpatient and outpatient settings using structured fields with the option to enter free-text comments (Figure 1). Inconsistent communication could potentially involve the following data elements of the structured fields: name of drug, dosage, administration route, schedule, administration time, days supplied, quantity, refills, and duration.

Pharmacy Reporting

In our institution, orders are electronically transmitted to an in-house pharmacy, where they are processed by 1 of 45 pharmacists. In general, pharmacists use their judgment to correct noted errors in the prescription or call the ordering provider. Institutional protocol requires pharmacists to call a provider if the modification of an inconsistency involves a change in administration route, dose, schedule, the name of the ordered drug, or unclear comments. Prior to and throughout the study period, pharmacists were educated about the study, reminded to report prescriptions containing inconsistencies to the research team pharmacist, and offered a small financial incentive. Of 45 pharmacists, 33 agreed to report errors.

Electronic Searches

Use of a single method (eg, stimulated self-reporting) has potential limitations in studies of medical errors.16 For instance, it cannot estimate error rate accurately.¹⁷ To overcome some of these disadvantages, we electronically searched for similar types of errors. We retrieved all prescriptions written during the study period containing comments in the free-text field and then randomly selected 500 for manual review to determine if they had inconsistent communication. Errors identified during manual review were cross-checked with those identified by pharmacists; if they were not present in the reported group, we considered them unreported errors. Prescriptions without errors from the latter sample were categorized as controls (Figure 2).

Figure 2

Study flowchart.

Data Collection

We developed a data collection form capturing the type of medication, setting (outpatient vs. inpatient), nature of the inconsistency in errors (drug dosage, administration time, schedule, days supplied, quantity, refills, or duration), and potentially predictive variables (representing instances in which communication errors may be more likely). Potentially predictive variables for communication errors included prescriptions requiring a complex order (where providers should use an alternate complex order window for order entry), less frequently prescribed (eg, restricted to certain specialties), medications considered “high-alert”¹⁸ (increased risk of causing patient harm if incorrectly used), and characteristics of the ordering providers. In cases of reported errors, pharmacists documented whether providers needed to be called and if the pharmacist filled the final prescription using information from the structured template, the free-text field, or in combination.

We used the Micromedex pharmaceutical classification system¹⁹ to group individual prescriptions into standardized drug classes. Two investigators (a physician and pharmacist) assigned harm categories by consensus using the Human Error Consequence Scale²⁰ after evaluating the results from the initial data collection. Harm categories were no error, inconvenience, very minor harm, minor harm, considerable harm, very serious harm, serious permanent damage, and immediate and inevitable death. The latter 4 categories were considered moderate to severe harm.

Data Analysis

We entered data into a Microsoft Access database (Redmond, Washington). A review of 80 random records validated quality of data entry. Of 5600 pieces of information collected in these 80 records, 5591 (99.8%) were found to be correct. Descriptive statistics were generated to characterize the inconsistent elements for all reported prescriptions. For prescriptions with and without inconsistent information, we compared the ordering provider characteristics (specialty and type of provider), setting of the error (eg, inpatient or outpatient), medication class (eg, antibiotics or analgesics), and other predictive variables (eg, less frequently prescribed or considered high alert). We also generated descriptive statistics for all harm categories. Univariate analysis was conducted using χ² and t tests. We used the Fisher exact test for categorical variables with 2 levels and the χ² test for categorical variables with more than 2 levels. We assessed statistical significance (α =.05) for tests of predictors using the Wald χ² test.

Multivariate logistic regression models were used to identify factors associated with communication errors and moderate to severe harm. A generalized estimating equation approach in which errors were nested within providers allowed us to account for the potential correlation among errors. For the first predictive model using the entire data set, the outcome variable was whether the pharmacy record contained inconsistent communication. For the second model, based on the subset of records with errors, the outcome was whether the error resulted in moderate to severe harm vs minor to no harm. Predictor variables included all covariates significant in univariate testing. We fit the models using maximum likelihood estimation and calculated odds ratios (ORs) and 95%confidence intervals (CIs). To ensure that the model had stable and precise estimates of ORs, variables with small numbers of patients with a given characteristic (eg, ordering providers listed as clinical support, clinical specialist, or unknown) were removed or combined (eg, geriatrics, other medicine, spinal cord injury, and psychiatry specialties were all combined as “other specialties” in the model to predict harm), and a final model was run using the remaining predictor variables. We used SAS version 9.1 (SAS Institute Inc, Cary, NC) to conduct all statistical analyses.

RESULTS

Of 55 992 new prescriptions processed and reviewed by the pharmacists in the study period, 532 were reported by pharmacists to contain inconsistent communication (0.95%). A computerized search of the 830 823 prescriptions written in our study period (which included both refills and new prescriptions) found 157 055 containing a comment in the free-text window (18.9%) (Figure 2). From the latter group, we randomly selected 500 for manual review and excluded 9 written for glucose-monitoring supplies. From the remaining 491 prescriptions containing comments, 26 were found to contain inconsistent communication (5.3%); none reported by pharmacists. An absence of overlap between reported (n=532) and unreported (n=26) errors of inconsistent communication was not unexpected based on previous literature.¹⁷ In addition, pharmacists do not review refills routinely, and almost a third of the pharmacists reported no errors. Unreported errors discovered through the computerized search and review were used to estimate frequency of the problem. Based on a 5.3% error rate in prescriptions with comments, we estimated the 157 055 prescriptions with comments might contain 8324 prescriptions with inconsistent communication (5.3%). Because these estimated 8324 errors derive from a larger sample of prescriptions with both refills and new prescriptions, we estimate the overall rate of errors of inconsistent information to be 1% (8324 of 830 823).

Table 1 lists the types of inconsistent communication errors in prescriptions reported by pharmacists, frequency of pharmacist contact with providers, and use of free-text information for final prescription fill. The most common inconsistent element across reported prescriptions was drug dosage (44.9%), followed by drug administration schedule (20.5%), duration of medication administration for inpatients (24.4%), medication administration time for inpatients (12.4%), route of administration (3.2%), and quantity of drug requested (1.7%). Pharmacists used the free-text comment in 88.9% of cases to fill the final prescription, the structured template in 9.2% of cases, and in combination in the remainder (1.9%). Pharmacists called providers in 149 cases (28.0%). In the 26 unreported errors, dosage inconsistency was also the most common (n=10; data not shown).

Table 1

Types of Inconsistent Communication Errors in Prescriptions Reported by Pharmacists^a

Table 2 lists the ordering provider characteristics, setting (inpatient or outpatient), medication classes, and other predictor variables of the 558 total study prescriptions containing inconsistent communication and the 465 controls. The following variables differed significantly between the 2 groups: ordering provider type (P=.04) and specialty (P<.001), inpatient vs outpatient setting (P<.001), and medication class (P<.001). Orders with inconsistent communication were most commonly entered by trainees (59.0%), followed by attending physicians (24.9%), physician assistants (10.2%), and nurse practitioners (5.4%). Most errors (68.3%) occurred in prescriptions for inpatients, and 19.0% (n=103) had 2 or more inconsistencies. The following medication classes were most commonly affected by errors: cardiovascular and antihypertensives (15.8%), analgesics (14.7%), antibiotics (10.8%), psychiatric medications (10.4%), and laxatives (7.5%). Only 2 reported errors were discovered after reaching the patient and did not result in harm. Medications needing a complex order (eg, a tapering dose of prednisone) were highly correlated with error. We also compared characteristics of reported and unreported errors in logistic regression analysis. Prescriptions with inconsistencies in schedule and administration route were less likely to be reported by pharmacists than prescriptions without schedule and route inconsistencies (OR, 0.18; 95% CI, 0.06–0.54 for schedule and OR, 0.14; 95% CI, 0.01–0.89 for route; data not shown in Table 2).

Table 2

Comparison of Prescriptions With and Without Errors of Inconsistent Communication in Computerized Provider Order Entry^a

Table 3 summarizes the results of the logistic regression model of predictors for inconsistent communication. Inpatient setting (OR, 3.30; 95% CI, 2.18–5.00) and non–primary care specialties such as surgery (OR, 2.45; 95% CI, 1.57–3.82) were more likely to have errors. Certain medication classes were also more likely to have errors, with the highest odds of error occurring for steroids (OR, 7.62; 95% CI, 3.11–18.63) compared with analgesics.

Table 3

Logistic Regression Model of Predictors for Errors of Inconsistent Communication in Computerized Provider Order Entry

Table 4 lists the potential harms associated with the 558 errors based on the Human Error Consequence Scale20 and the 3 most common drug classes for each category of harm. Even though 29.4% of errors were categorized as inconvenience, 112 errors could have resulted in moderate to severe harm (considerable, very serious, serious permanent damage, or death) (20.1%). Anticoagulants and cardiovascular drugs were the most frequent categories involving moderate to severe harm. Table 5 summarizes the results of the logistic regression analysis of the 112 errors that could potentially have led to moderate to severe harm. Medications ordered by providers in the outpatient setting had higher risk (OR, 2.23; 95% CI, 1.15–4.35) for causing moderate to severe harm than those ordered for inpatients. Medications ordered by providers in specialties other than primary care and surgery had lower risk (OR, 0.30; 95% CI, 0.14–0.63) than those ordered by providers in primary care. Of all medication classes, anticoagulants were associated with the highest risk of causing potentially moderate to severe harm (OR, 61.89; 95% CI, 10.73–356.93). As expected, medications considered high alert (OR, 3.43; 95% CI, 1.62–7.27) had a high potential for causing moderate to severe harm. Of note, 23.1% of unreported errors could have resulted in moderate to severe harm, statistically no different from reported errors (P=.62).

Table 4

Outcome Categories for Harm From Errors of Inconsistent Communication in Computerized Provider Order Entry

Table 5

Logistic Regression Analysis of Predictors for Moderate to Severe Harm^a From Errors of Inconsistent Communication in CPOE

COMMENT

We used a combination of 2 methods, pharmacist stimulated self-report and an electronic search followed by manual review, to describe errors related to inconsistent communication of prescribing information through an advanced CPOE system. Over a 4-month study period, 33 pharmacists reported 532 errors where information entered in the structured template of CPOE did not match the information in the corresponding free text comment field. We estimate that such errors of inconsistent communication could occur in at least 1% of all CPOE prescriptions and 5.3% of all prescriptions containing free-text comments. Most inconsistencies related to dosage. About 20% of identified errors could have resulted in moderate to severe harm; anticoagulants had the highest risk in a logistic model. Our results suggest that despite attempted standardization of data entry, inconsistent communication poses significant risks to safety achieved by computerized medication order entry.²

Despite the risk of inconsistent communication and the inability to run system cross-checks against the uncoded free-text data, several benefits exist. In a previous study, 92% of users reported that CPOE was inflexible 9; the free text window offers a valuable option to communicate clarifications or nonstandard information. In fact, in over 90% of cases the pharmacists used the free-text information either by itself or combined it with information from the structured template, underscoring the importance of this window. Given other advantages of using unconstrained, narrative information in computerized information systems,⁵^,¹⁴ we believe the free-text window should be maintained in CPOE systems but with improvements to avoid inconsistencies.

We obtained a comparable estimate of error rate (ie, 1%) using both reporting and electronic search, adding strength to our findings. Additional study strengths include a large variety of medications, a large number of providers (>500), and an advanced CPOE system fairly representative of other systems. All CPOE systems have some method of entering free text. Chused et al²¹ recently reported communication failures resulting from free-text comments entered in response to alert overrides, suggesting that commercial CPOE systems may not also protect against the problem. To our knowledge, this is also the first study reporting errors of communication due to free-text comments in CPOE systems.

We have drawn several preliminary conclusions about the origin of inconsistent communication and propose some preliminary interventions. First, providers often selected an automated dosage default rather than typing the desired dosage. Although defaults can be helpful, they may not be comprehensive and may be based on inventory rather than clinical guidelines. We found some defaults to be needlessly restrictive (eg, administration time). Although default settings are designed to save time and increase efficiency, it appeared that providers did not realize many could be changed. While default options may improve care in some settings,²² our results suggest a need for more careful consideration before their use.

Second, comments were transferred to the new prescription when modifying an existing prescription. This may not be appropriate, and we suggest that system developers force users to actively request such transfers.

Third, insufficient knowledge of the ordering mechanism appears to be a common problem, and simple training on the use of complex orders for certain prescriptions could reduce errors. For instance, providers would often use the free-text window to write complex prescriptions that were frequently associated with error (eg, prednisone taper). Certain specialties had higher odds for error perhaps because they wrote relatively fewer prescriptions or were less familiar with CPOE.

Finally, many of the errors and issues suggest that standardization through CPOE was not adequately integrated with the workflow, needs, and preferences of the providers.²³^,²⁴ For instance, we found errors that could be prevented by minor modifications in the CPOE template regarding administration time or duration and/or stop time for a medication.

Our study adds to the growing body of knowledge that computerized information systems may introduce new types of errors, including those involving communication processes.⁵^,²⁵ Future studies should address the usability of the CPOE interface to identify breakdown points and maximize the effectiveness, efficiency, and satisfaction of electronic communication.²⁶^,²⁷ Using a multifaceted interdisciplinary approach to the problem would generate the best solutions.²⁸^,²⁹ Interventions aimed at reducing communication errors at the human-CPOE interface³⁰ will need grounding in principles of human computer interaction. Even though most errors of inconsistent communication would have caused inconvenience or minor harm, the potential for more severe harm is significant, given the large volume of prescriptions written. Certain commonly prescribed medications such as anticoagulants posed a particularly high risk for moderate to severe harm. Pharmacists continue to play a prominent role in achieving medication safety in advanced CPOE systems.³¹

We note several limitations of our study. It was conducted at a single site where all providers used the same CPOE system, and although it involved a large number of patients and providers, including trainees, generalizability may be limited. Because underreporting is a well recognized phenomenon in similar studies, our findings may underestimate the problems caused by inconsistencies in the orders; the 12 pharmacists who chose not to participate cited time as a factor. Other studies have also found significant differences among pharmacists in error reporting. ³² Only slightly more than two-thirds of eligible pharmacists participated in the study, and hence there is almost certainly selection bias. Furthermore, while it is likely that similar communication breakdowns occur in other Veterans Affairs facilities using the same CPOE system, we ac-knowledge that the true prevalence across Veterans Affairs institutions is unknown. Despite these limitations, we believe that this project highlights an important issue and serves as a model for others seeking to enhance safety and usability of advanced CPOE systems.

In conclusion, in spite of attempted standardization of data entry, inconsistent communication poses a significant risk to safety achieved by CPOE. We found that errors related to inconsistent information in a state-of-the- art CPOE system occurred in at least 1% of all prescriptions, and this rate increased to at least 5% in a sample of prescriptions with associated free-text comments. Although most errors we studied did not reach the patient because of pharmacist intervention, they pose a significant potential risk to patients. The potential for moderate to severe harm is likely more significant given the expected increase in the volume of prescriptions written through future CPOE systems. Improving the usability of the CPOE interface and integrating it with workflow may reduce this risk. Future studies should identify breakdown points and maximize the effectiveness, efficiency, and satisfaction of electronic communication through CPOE.²⁶

Acknowledgments

Funding/Support: This study was supported by the Veterans Affairs National Center for Patient Safety; National Institutes of Health K23 career development award K23CA125585 (Dr Singh); and in part by grant HFP90-020 from the Houston VA HSR&D Center of Excellence (Dr L. A. Petersen).

Role of the Sponsors: The funding sources had no role in the design or conduct of the study; collection, management, analysis, or interpretation of the data; or preparation, review, or approval of the manuscript.

Footnotes

Financial Disclosure: None reported.

Disclaimer: The views expressed in this article are those of the authors and do not necessarily represent the views of the Department of Veterans Affairs.

Author Contributions: Drs Singh and N. Petersen had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design: Singh, Mani, and L. A. Petersen. Acquisition of data: Singh, Mani, Espadas, and Franklin. Analysis and interpretation of data: Singh, Mani, N. Petersen, and L. A. Petersen. Drafting of the manuscript: Singh, Mani, Espadas, and Franklin. Critical revision of the manuscript for important intellectual content: Singh, Mani, N. Petersen, and L. A. Petersen. Statistical analysis: N. Petersen. Obtained funding: Singh and L. A. Petersen. Administrative, technical, and material support: Singh, Mani, Espadas, Franklin, and L. A. Petersen. Study supervision: Singh and L. A. Petersen.

Additional Contributions: Dean Sittig, PhD, provided valuable comments on an earlier version of the manuscript, and Donna Kyle, RPh, MS, provided support for our project.

Reference List

1. Bates DW, Kuperman G, Teich JM. Computerized physician order entry and quality of care. Qual Manag Health Care. 1994;2(4):18–27. [PubMed]

2. Bates DW, Leape LL, Cullen DJ, et al. Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA. 1998 October 21;280(15):1311–6. [PubMed]

3. Institute of Medicine. To Err is Human: Building a Safer Health System. Washington, D.C: National Academies Press; 1999.

4. Sittig DF, Stead WW. Computer-based physician order entry: the state of the art. J Am Med Inform Assoc. 1994 March;1(2):108–23. [PMC free article] [PubMed]

5. Ash JS, Berg M, Coiera E. Some unintended consequences of information technology in health care: the nature of patient care information system-related errors. J Am Med Inform Assoc. 2004 March;11(2):104–12. [PMC free article] [PubMed]

6. Berger RG, Kichak JP. Computerized physician order entry: helpful or harmful? J Am Med Inform Assoc. 2004 March;11(2):100–3. [PMC free article] [PubMed]

7. Harrison MI, Koppel R, Bar-Lev S. Unintended consequences of information technologies in health care--an interactive sociotechnical analysis. J Am Med Inform Assoc. 2007 September;14(5):542–9. [PMC free article] [PubMed]

8. Horsky J, Kuperman GJ, Patel VL. Comprehensive analysis of a medication dosing error related to CPOE. Journal Of The American Medical Informatics Association: JAMIA. 12(4):377–82. [PMC free article] [PubMed]

9. Koppel R, Metlay JP, Cohen A, et al. Role of computerized physician order entry systems in facilitating medication errors. JAMA. 2005 March 9;293(10):1197–203. [PubMed]

10. Weiner JP, Kfuri T, Chan K, Fowles JB. “e-Iatrogenesis”: the most critical unintended consequence of CPOE and other HIT. J Am Med Inform Assoc. 2007 May;14(3):387–8. [PMC free article] [PubMed]

11. Kaushal R, Shojania KG, Bates DW. Effects of computerized physician order entry and clinical decision support systems on medication safety: a systematic review. Arch Intern Med. 2003 June 23;163(12):1409–16. [PubMed]

12. Nebeker JR, Hoffman JM, Weir CR, Bennett CL, Hurdle JF. High rates of adverse drug events in a highly computerized hospital. Arch Intern Med. 2005 May 23;165(10):1111–6. [PubMed]

13. Bates DW, Cullen DJ, Laird N, et al. Incidence of adverse drug events and potential adverse drug events. Implications for prevention. ADE Prevention Study Group. JAMA. 1995 July 5;274(1):29–34. [PubMed]

14. McDonald CJ, Overhage JM, Mamlin BW, Dexter PD, Tierney WM. Physicians, Information Technology, and Health Care Systems: A Journey, Not a Destination. J Am Med Inform Assoc. 2004 March 1;11(2):121–4. [PMC free article] [PubMed]

15. Joint Commission on Accreditation of Healthcare Organizations. Sentinel event statistics, March 31, 2006. Joint Commission on Accreditation of Healthcare Organizations; 2005. Available at: URL: http://www.jointcommission.org/NR/rdonlyres/FA465646-5F5F-4543-AC8F-E8AF6571E372/0/root_cause_se.jpg.

16. O’Neil AC, Petersen LA, Cook EF, Bates DW, Lee TH, Brennan TA. Physician reporting compared with medical-record review to identify adverse medical events. Ann Intern Med. 1993 September 1;119(5):370–6. [PubMed]

17. Thomas EJ, Petersen LA. Measuring errors and adverse events in health care. J Gen Intern Med. 2003 January;18(1):61–7. [PMC free article] [PubMed]

18. Institute for Safe Medication Practices. ISMP’s List of high-alert Medications. 2008.

19. Thomas Reuters Healthcare. Micromedex® Healthcare Series [Internet database] [Accessed November 19, 2008.]. http://www.micromedex.com/products/hcs/

20. Gilpatrick E. Health Services Mobility Study. Final Report (October 1967-March 1972) New York, NY: City Univ. of New York Research Foundation; 1972. Jan 1, Report No.: ERIC Reports ED066613.

21. Chused AE, Kuperman G, Stetson PD. Alert override reasons: A failure to communicate. AMIA Annu Symp Proc 2008. 2008 Fall; In Press. [PMC free article] [PubMed]

22. Halpern SD, Ubel PA, Asch DA. Harnessing the power of default options to improve health care. N Engl J Med. 2007 September 27;357(13):1340–4. [PubMed]

23. Campbell EM, Guappone KP, Sittig DF, Dykstra RH, Ash JS. Computerized Provider Order Entry Adoption: Implications for Clinical Workflow. Journal of General Internal Medicine. 2008 In press. [PMC free article] [PubMed]

24. Aarts J, Ash J, Berg M. Extending the understanding of computerized physician order entry: implications for professional collaboration, workflow and quality of care. Int J Med Inform. 2007 June;76( Suppl 1):S4–13. [PubMed]

25. Campbell EM, Sittig DF, Ash JS, Guappone KP, Dykstra RH. Types of Unintended Consequences Related to Computerized Provider Order Entry. J Am Med Inform Assoc. 2006 September 1;13(5):547–56. [PMC free article] [PubMed]

26. Schoeffel R. ISO Bulletin 34[3], 6–7. 2003. The concept of product usability. Ref Type: Generic.

27. Barber N, Cornford T, Klecun E. Qualitative evaluation of an electronic prescribing and administration system. Qual Saf Health Care. 2007 August;16(4):271–8. [PMC free article] [PubMed]

28. Horsky J, Zhang J, Patel VL. To err is not entirely human: Complex technology and user cognition. Journal of Biomedical Informatics. 2005 August;38(4):264–6. [PubMed]

29. Koppel R, Localio AR, Cohen A, Strom BL. Neither panacea nor black box: Responding to three Journal of Biomedical Informatics papers on computerized physician order entry systems. Journal of Biomedical Informatics. 2005 August;38(4):267–9. [PubMed]

30. Preece J, Rogers Y, Sharp H, Benyon D, Holland S, Carey T. Human-computer interaction. New York: Addison-Wesley Publishing Company; 1994.

31. Bobb A, Gleason K, Husch M, Feinglass J, Yarnold PR, Noskin GA. The epidemiology of prescribing errors: the potential impact of computerized prescriber order entry. Arch Intern Med. 2004 April 12;164(7):785–92. [PubMed]

32. Kennedy AG, Littenberg B. Medication error reporting by community pharmacists in Vermont. J Am Pharm Assoc (2003 ) 2004 July;44(4):434–8. [PubMed]