|Home | About | Journals | Submit | Contact Us | Français|
Prior studies have documented a high prevalence of patients misunderstanding prescription drug warning labels, placing them at risk for medication error. We evaluated whether the use of ‘enhanced print’ drug warnings could improve patient comprehension beyond a current standard.
An evaluation of ‘enhanced print’ warning labels was conducted at two academic and two community health primary care clinics in Chicago, IL and Shreveport, LA. In total, 500 adult patients were consecutively recruited and assigned to receive 1) current standard drug warning labels on prescription containers (standard), 2) drug warnings with text rewritten in plain language (simplified text), or 3) plain language and icons developed with patient feedback (simplified text + icon). The primary outcome was correct interpretation of nine drug warning labels as determined by a blinded panel review of patients’ verbatim responses.
Overall rates of correct interpretation of drug warnings varied among standard, simplified text, and simplified text + icon labels (80.3%, 90.6%, and 92.1% respectively; p<0.001). Warnings with simplified text and simplified text + icons were more likely to be correctly interpreted compared to standard labels (simplified text – Adjusted Odds Ratio (AOR) 2.64, 95% CI 2.00-3.49; simplified text + icons – AOR 3.26, 95% CI 2.46-4.32). Patients’ ability to correctly interpret labels was not significantly different with the inclusion of icons (simplified text + icons – AOR 1.23, 95% CI 0.90-1.67, p=0.20). Low literacy was also an independent predictor of misinterpretation (AOR 0.65, 95% CI 0.44-0.94). Patients with marginal and low literacy were better able to correctly interpret warning labels with simplified text + icons compared to labels with simplified text only (marginal – AOR 2.59, 95% CI 1.24-5.44, p=0.01; low – AOR 3.22, 95% CI 1.39-7.50, p=0.006).
Simple, explicit language on warning labels can increase patient understanding; the addition of appropriate icons is particularly useful for lower literate adults. Evidence-based standards are needed to promote patient-centered prescription labeling practices.
A current and well-publicized body of research has focused on the ability of patients to read, understand, and demonstrate instructions on prescription medication container labels.1-4 In particular, recent studies have documented a high prevalence of patients misinterpreting seemingly simple auxiliary warnings and instructions provided on the labels of medication containers.3,4 More than half (54%) of adults misunderstood one or more common prescription warnings and precautions. Older patients and those with limited literacy skills had the greatest difficulty interpreting the text messages and icons used on the labels. Two Institute of Medicine (IOM) reports, Preventing Medication Error (2006) and Standardizing Medication Labels (2008) have concluded that drug labeling itself is not patient-centered and is a root cause of a large proportion of medication errors.5,6
The Food and Drug Administration (FDA) along with numerous medical, pharmacy, and public health organizations are directing greater attention to the quality of prescription drug labeling.6-10 More than a decade ago the Keystone Dialogue was initiated by the Department of Health and Human Services and the above-mentioned organizations to develop an action plan for improving medication labeling.11 One of the recommendations was to involve consumers in the development of prescription drug information, including drug warning labels, to gain assurances that content would be properly understood by patients across all literacy levels. To date, little progress has been made by these organizations to improve or standardize warning labels for prescription drug containers.
We recently developed and pilot tested a set of ‘enhanced print’ prescription drug warning labels that we hypothesized would be more easily understood by a diverse set of individuals, including those with limited literacy.12 This process involved patients in the writing of the warning messages and design of complimentary graphic icons. The objective of the current study was to evaluate whether the use of these enhanced drug warnings improved patient comprehension beyond a current practice standard.
A three-arm, cross-sectional evaluation was conducted testing the efficacy of enhanced auxiliary drug warning labels. Specifically, patients were assigned to receive 1) the current standard drug warning labels on prescription containers [standard], 2) ‘enhanced’ drug warnings with text rewritten in plain language [simplified text], or 3) the enhanced language on drug warnings and also icons developed with patient feedback to support the text messages [simplified text + icon] .
Adult patients who attended one of four outpatient primary care clinics were recruited in two distinct cities (Shreveport, Louisiana; Chicago, Illinois). One clinic in each city was a general medicine academic practice; a second clinic was a safety net community health center. Subject recruitment took place between June and August 2007. Patients were considered eligible for the study if they were 18 years of age or older, and ineligible if the clinic nurse or study research assistant identified a patient as having one or more of the following conditions: (1) severely impaired vision; (2) hearing problems; (3) too ill to participate in the survey; 4) non-English speaking. Institutional Review Boards for all locations approved the study. A total of 562 patients were approached in the order they arrived at the clinics and prior to the medical encounter; 530 consented to the study. Thirteen patients were excluded based on self-reported impairments with hearing (n=3) or vision (n=10). Ten patients were excluded due to limited English proficiency, and seven others were excluded based on incomplete information. In all, 500 patients participated in the study; the sample was evenly split across the two study locations (n=250 per city) and practice setting (academic, community; n=125 within each study location). A response rate was determined following the American Association for Public Opinion Research standards, estimating 92.8 percent of approached eligible patients participated in the study.13
The intervention was the use of ‘enhanced’ auxiliary prescription drug warning labels, with or without patient-centered icons to support comprehension. Previously, nine of the most commonly-used drug warnings and/or precautions placed directly on prescription medication bottles were revised with patient feedback and pilot tested.12 Specifically, text was rewritten using more clear, concise, and explicit language. The icons supporting comprehension of the text message were altered to more accurately reflect the mental representations patients identified with each warning, or to use a default, universal cautionary symbol when not deemed possible (see Table 1). Guidelines established by the International Organization for Standardization for the development and testing of universal icons were followed.14 Other design elements were also implemented, including removal of the use of color and optimizing font size for clarity.
A structured “cognitive” interview protocol was developed to assess patient understanding of the drug labels; a process previously used by our research team.1-4,15 After patients consented to the study, a trained research assistant administered the structured interview that included self-report of sociodemographic information (age, gender, race/ethnicity, education, number of prescription medications currently taken daily). Actual prescription pill bottle containers with drug warning labels attached were then shown to all of the patients for review. Once the patient provided their interpretations, the research assistant administered the Rapid Estimate of Adult Literacy in Medicine (REALM), a reading recognition test comprised of 66 health-related words. The REALM is the most commonly used test of patient literacy in medical settings.16 It is highly correlated with standardized reading tests and the Test of Functional Health Literacy in Adults.17, 18
Nine drug warnings were used in this study. Each warning had three versions (standard, simplified text, simplified text + icon) for a combined total of 27 labels under evaluation. Within each label version, warnings were randomly organized into groups of three labels and then placed on the back of Target ClearRx® flat-panel prescription bottles (see Figure). Each bottle therefore had three labels, all of which were either standard, simplified text, or simplified text+icon. We viewed three warnings on a bottle to be a realistic portrayal of the number of warnings commonly found on pill bottles; many pharmacies allot space for as many as five per bottle (see Figure). In total, nine bottles were created (three bottles per label version).
The initial order of the warnings on the back of the bottle (e.g. first, second, or third position) was also randomly assigned and replicated across all label versions (see Figure). The bottles were then randomly grouped into three sets; every set containing one bottle from each label version and all of the nine warnings (Table 1). Patients thereby were exposed to all of the drug warnings and each label type, only seeing one version of each warning message. Consecutive patients scheduled for medical appointments at each of the clinics that consented to the study were sequentially assigned to one of the three regimens to review.
Patient correct interpretation of the nine prescription drug warnings placed on container vials was evaluated. A trained research assistant at each location would direct patients to the back of one of three prescription vials, and ask “In your own words, what do these labels mean to you?” The patient’s verbatim responses were documented on a separate form. All patient responses to each of nine drug warnings were then independently rated as either correct or incorrect by three general internal medicine attending physicians from three different academic medical centers.
Each physician rater was blinded to all patient information and was trained to follow stringent coding guidelines agreed upon previously by the research team. Specifically, correct scores were to be given only if the patient’s response included all aspects of the label’s message. Responses were given an incorrect score if they were inaccurate, or if they did not contain all aspects of the warning. During the coding process it was noted that many subjects did not attempt to interpret all of the warning labels on a bottle. If a patient did not respond to a warning label, this was coded as ‘non-attendance’.
Inter-rater reliability between the three physicians coding the patient responses was high (Kappa = 0.87). The 380 responses (8.4%) that received discordant ratings between the three reviewers were sent to an expert panel that included a primary care physician and clinical psychologist and health services researcher with expertise in health literacy for further review. Each panel member, also blinded to patient information, independently reviewed and coded the responses as correct or incorrect. For 86.1 percent (n=327) of the 380 responses, a consensus ruling was achieved among the expert panel for a final ruling on the coding of those responses. For the remaining 53 patient responses, a majority rule was imposed and the rating by a minimum of two panel members was used to determine the scores.
Descriptive statistics (percentage, mean and standard deviation) were calculated for patient demographic characteristics, literacy, attendance to and correct interpretation of each individual warning label. Chi-square tests were used to evaluate the association between label type and patient understanding of each of the nine prescription medication primary label instructions, but also attendance to the auxiliary labels. The latter was viewed as an unexpected but important outcome of interest with significant implications to clinical practice. For that reason, multivariate analyses were conducted first modeling attendance to each of the warnings, followed by correct interpretation. The nine binary repeated responses of attendance or correct interpretation per subject were modeled using a generalized linear model with a binomial distribution and logit link function. A generalized estimating equation (GEE) approach was used to adjust model coefficients and standard errors for within-patient correlation. An unstructured correlation structure was specified. The primary independent variable of interest for both models was label type (simplified text, simplified text + icon vs. current standard). The final multivariate model included the potential confounding variables age, gender, race (African American vs. white), literacy (low (6th grade and below), marginal (7th -8th grade) or adequate (9th grade and higher)), education, and number of medications currently taken daily. While education attainment is associated with literacy, it was examined separately but included in the final model to present conservative estimates of the effect of literacy on rates of understanding. This issue has previously been reviewed by Wolf and colleagues and the same method used.19 Site was also entered into the model to adjust for any potential differences across study locations. Potential interactions between label type and literacy as well as all combinations of age, education, race, literacy and label type were tested in additional models. . All statistical analyses were performed using STATA software version 10.0 (College Station, TX).
The mean age of respondents (N=500) was 48.9 years (SD=14.4; range 18 to 83 years). Sixty percent were female, nearly two thirds (63.6%) were African American and one third (32.8%) were white; 19.4 percent reported less than a high school level of education attainment (Table 2). Patient literacy was limited; 20.1 percent were reading below a seventh grade level (low literacy) and 32.0 percent were reading at the seventh to eighth grade level (marginal literacy). Patients were taking an average of 2.9 prescription medications. Lower literacy was associated with older age (p<0.001), African American race (p<0.001), less education (p<0.001), and the Shreveport study site (p<0.001). No significant differences were reported between literacy level, gender or number of prescription medications taken daily.
Overall, patients gave a total of 3,328 responses out of a possible 4,500 (74.0%) across the nine prescription drug warnings they were given to review; a non-response represented patients not attending to and attempting to interpret a warning on the bottle (Table 3). Overall rates of attendance to drug warnings on the prescription bottles significantly varied among standard, simplified text, and simplified text + icon warning labels (70.2%, 73.4%, and 78.3% respectively, p<0.001). Simplified text labels (with or without icons) that cautioned Use only on your skin, Talk to your doctor before using any over-the-counter drugs, and Do not stop taking unless directed by your doctor were more likely to be attended to by patients than their standard warning label counterparts (Table 3). Simplified text + icon labels stating to Take with food or milk and that a medication May cause drowsiness. Be careful when driving a car or using machinery were better attended by respondents than simplified text only or standard labels.
Among the 3,328 patient attempts to interpret drug warnings, 403 (12.1%) were coded as incorrect (Table 3). Overall rates of correct interpretation significantly varied by label type; with simplified text + icon and simplified text only warnings more likely to be properly understood compared to standard warnings (92.1%, 90.6%, and 80.3% respectively; p<0.001). The same simplified text and simplified text + icon labels that were better attended to by patients compared to standard warnings were more likely to be correctly interpreted, with the inclusion of the instruction, Limit your time in the sun (Table 3). Simplified text labels that warned not to drink alcohol were better understood than standard warnings (98.3% vs. 89.3%, p=0.02).
In multivariate analyses, both label type and label order were associated with attendance to the auxiliary drug warning labels (Table 4). Simplified text labels, with and without patient-centered icons, were better attended to by patients than standard labels (simplified text - Adjusted Odds Ratio (AOR) 1.17, 95% Confidence Interval (CI) 1.02-1.36; simplified text + icon – AOR 1.59, 95% CI 1.38-1.83). When the reference group was altered from the standard label to the simplified text label, warnings that included both simplified text and icons were found to be better attended to than the labels with simplified text only (AOR 1.35, 95% CI 1.19-1.55; p<0.001). Labels that were not in the most prominent (first) position on the container were less likely to be attended to by patients (second position – AOR 0.79, 95% CI 0.70-0.90; third position – AOR 0.70, 95% CI 0.62-0.79). In addition, older age, male gender, and fewer years of schooling were statistically significant independent predictors of poorer attendance to drug warnings. A significant interaction was found between label type and literacy level. Patients with low literacy were more likely to attend to simplified text labels compared to the standard (AOR 1.60, 95% CI 1.09-2.33; p=0.02); no differences were noted between attendance to labels with simplified text vs. simplified text + icons by those with low literacy skills.
Beyond attendance, prescription drug warning labels with simplified text and simplified text + icons were also significantly more likely to be correctly interpreted compared to standard labels (simplified text – AOR 2.64, 95% CI 2.00-3.48; simplified text + icons – AOR 3.26, 95% CI 2.46-4.32; Table 4). When the reference group was changed to labels with simplified text only, patients’ ability to correctly interpret labels was not significantly different with the inclusion of the patient-centered icon (simplified text + icons – AOR 1.23, 95% CI 0.90-1.70, p=0.20). Low literacy was also a significant independent predictor of misinterpretation (AOR 0.65, 95% CI 0.44-0.94). Similar to the outcome of attendance, an interaction between label type and literacy level was found. Patients with marginal and low literacy were better able to correctly interpret warning labels with simplified text and icons compared to labels with simplified text only (marginal – AOR 2.59, 95% CI 1.24-5.44, p=0.01; low – AOR 3.22, 95% CI 1.39-7.50, p=0.006). Similar differences were found between simplified text and patient-centered icons and standard labels (which included both text and icons) among individuals with limited literacy (marginal – AOR 1.99, 95% CI 1.01-3.90, p=0.05; low – AOR 2.13, 95% CI 1.04-4.40, p=0.04).
In our study, many patients did not attend to or correctly interpret potentially important warning information commonly placed on prescription drug containers to support proper understanding and use. However, auxiliary warning labels that had explicit, easy-to-read messages significantly improved rates of attendance and comprehension among patients. The inclusion of icons on warning labels, developed with patient feedback, was found to further improve attendance and correct interpretation among individuals with low literacy skills. Both the use of explicit language and icons has previously been found to support comprehension of health materials.15,20-23 While the study further confirms the value of these ‘enhanced’ print attributes to increase patient understanding, our findings may offer additional guidance to clinical practice as detailed below.
First, not all of the patient-centered icons were effective at improving comprehension beyond the revised text. In particular, a few of the icons provided abstract imagery for messages that were more difficult to visually depict in such a small size, such as Use only on your skin. It may not be possible or necessary to create icons for every warning message. Rather, one approach might be to use established thresholds for rates of comprehension, as in the process detailed by the International Organization for Standardization (i.e. >80%), to determine the adequacy of a particular icon or drug warning.13 Given the limited space for content on prescription drug containers, it would be helpful to only include those icons that have been shown in consumer testing to significantly improve comprehension beyond simplified text alone.
Second, patients were less likely to attend to drug warnings, regardless of label type, if they were in the second or third position on the prescription container. In broad terms, it is possible that warnings are not perceived as essential information aiding patients in their use of a medication. Patients might provide only a cursory glance at the content of these labels, not believing the task to require considerable attention. Previous research has reported that patients do not seem to expend a great deal of cognitive effort in reviewing medication instructions and precautions, and as a result they may be at greater risk for making errors.2,4 Yet this finding could indicate a level of distraction imparted to patients by the considerable content placed on a relatively limited amount of space. A practical solution may be to limit the number of auxiliary warnings to only the one or two deemed most critical to a prescribed drug’s safe and appropriate use. Any other warnings could be referenced in supplemental patient medication information materials. A note to that regard could also be placed on the container label to direct patients to the accompanying patient leaflets or Medication Guides. In order to accomplish this, a detailed investigation of the current pharmacological evidence supporting each of the warnings and precautions associated with each prescription drug would need to be performed.
Third, it is important to note that patient literacy level remained a significant independent predictor of correct interpretation of drug warnings. The use of patient-centered icons along with the clear, concise instructions and/or precautions may improve comprehension among lower literate patients. However, it is likely that ‘enhanced’ print materials alone are insufficient for addressing literacy disparities. Patient counseling, in addition to better labeling practices, will be necessary in order to formidably respond to health literacy problems. Previous research has shown that physicians do not commonly review medication instructions at the time of prescribing, nor do pharmacists routinely verbally counsel patients when filling prescriptions.24-26 More effective communication strategies should be devised to ensure both prescribing clinicians and pharmacists can adequately counsel patients and provide simple, clear and explicit information on how to safely use their medicine.
There are several limitations to our study that should be recognized. To begin, we investigated patient comprehension of different styles of writing warning instructions and precautions and the utility of icons to support understanding only. The association between misinterpretation of these warning labels and medication error was not examined. We also did not study patients’ actual prescription drug-taking behaviors. Patients’ motivation, concentration and comprehension might have been greater if they were reporting on their own medicine given by their physician for conditions they actually had.27-29 Since the study design did not include a chart review, we also did not have information on patients’ health information; in particular whether they had actual experience with medication use. While labels were randomly grouped, patients themselves were not randomized. However, no differences were noted by demographic characteristics or literacy level across study arms. Other elements of the study container and labels (i.e. Target’s ClearRx® flat panel bottle, use of color on warning labels, number of warnings per bottle) were not directly evaluated in this investigation but also might influence comprehension. Finally, the generalizability of our findings is further limited by the fact that patients were predominantly African American and female (an accurate depiction of the clinic patient populations), and that participation was limited to patients who spoke English. This was due in part to criteria for using the REALM as our literacy assessment. As many pharmacies are limited in their ability to provide language concordant services, it is of increasing importance for studies to examine ways to communicate prescription warning information to patients with limited English proficiency (LEP).30 The use of the patient-centered icons, in particular, may be especially helpful and should be evaluated among LEP populations.
In summary, prescription warnings placed on the container label may be particularly valuable to patients as the most tangible source of medication information. Presently, there are several companies that produce auxiliary warning labels (as part of a software package or as container stickers) for use among community pharmacies, including the pharmacies themselves. As a result, different messages and icons may be used to convey similar messages regarding medication administration. A large number of these instructions and precautions remain unnecessarily complex, and seldom tested for comprehension among consumers to include their feedback in the development process. We offer further evidence for setting forth best practices in the design and development of patient-centered prescription drug warnings for use on container labels. Regulatory and policy-setting entities, including the Food & Drug Administration, U.S. Pharmacopeia, and state boards of pharmacy should consider setting standards for assuring a single recommended list of prescription drug warnings that include comprehensible language and icons are used.
We would like to thank Mickey Eder, PhD and Access Community Health Network for their support of this project. Drs. Wolf, Davis, and Parker received grant support from Target Corporation for work on this project. In addition, Dr. Wolf has previously received financial support for research, consultation, and grant review services from Pfizer Pharmaceuticals.
Financial Support: Research and faculty support was provided by grants from Target Corporation and the Agency for Healthcare Research and Quality (R01HS017687, PI: Wolf).