The development of a web- and a print-based decision aid for prostate cancer screening

doi:10.1186/1472-6947-10-12

BMC Med Inform Decis Mak. 2010; 10: 12.

Published online 2010 March 3. doi: 10.1186/1472-6947-10-12

PMCID: PMC2845091

The development of a web- and a print-based decision aid for prostate cancer screening

Caroline S Dorfman,¹ Randi M Williams,¹ Elisabeth C Kassan,¹ Sara N Red,¹ David L Dawson,¹ William Tuong,¹ Elizabeth R Parker,¹ Janet Ohene-Frempong,² Kimberly M Davis,¹ Alexander H Krist,³ Steven H Woolf,³ Marc D Schwartz,¹ Mary B Fishman,⁴ Carmella Cole,⁵ and Kathryn L Taylor¹

¹Department of Oncology, Lombardi Comprehensive Cancer Center, Georgetown University Medical Center, 3300 Whitehaven Street, NW Suite 4100, Washington, DC 20007-2401, USA

²The Clear Language Group, 7907 Roneale Drive, Elkins Park, PA 19012-1115, USA

³Department of Family Medicine, Virginia Commonwealth University, PO Box 980251 Richmond VA 23298-0251, USA

⁴Division of General Internal Medicine, Georgetown University Hospital, 3800 Reservoir Rd NW, Washington, DC 20007, USA

⁵Division of General Internal Medicine, Washington Hospital Center, 110 Irving Street, NW, Washington, DC 20010, USA

Corresponding author.

Caroline S Dorfman: caroline.dorfman/at/gmail.com; Randi M Williams: rmw27/at/georgetown.edu; Elisabeth C Kassan: eck33/at/georgetown.edu; Sara N Red: saranred/at/gmail.com; David L Dawson: dld27/at/georgetown.edu; William Tuong: wt45/at/georgetown.edu; Elizabeth R Parker: betsparker/at/gmail.com; Janet Ohene-Frempong: jofrempong/at/comcast.net; Kimberly M Davis: kmd54/at/georgetown.edu; Alexander H Krist: ahkrist/at/mail1.vcu.edu; Steven H Woolf: swoolf/at/vcu.edu; Marc D Schwartz: schwartm/at/georgetown.edu; Mary B Fishman: mbf3/at/gunet.georgetown.edu; Carmella Cole: Carmella.a.cole/at/medstar.net; Kathryn L Taylor: taylorkl/at/georgetown.edu

Received July 16, 2009; Accepted March 3, 2010.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

This article has been cited by other articles in PMC.

Abstract

Background

Whether early detection and treatment of prostate cancer (PCa) will reduce disease-related mortality remains uncertain. As a result, tools are needed to facilitate informed decision making. While there have been several decision aids (DAs) developed and tested, very few have included an exercise to help men clarify their values and preferences about PCa screening. Further, only one DA has utilized an interactive web-based format, which allows for an expansion and customization of the material. We describe the development of two DAs, a booklet and an interactive website, each with a values clarification component and designed for use in diverse settings.

Methods

We conducted two feasibility studies to assess men's (45-70 years) Internet access and their willingness to use a web- vs. a print-based tool. The booklet was adapted from two previous versions evaluated in randomized controlled trials (RCTs) and the website was created to closely match the content of the revised booklet. Usability testing was conducted to obtain feedback regarding draft versions of the materials. The tools were also reviewed by a plain language expert and the interdisciplinary research team. Feedback on the content and presentation led to iterative modifications of the tools.

Results

The feasibility studies confirmed that the Internet was a viable medium, as the majority of men used a computer, had access to the Internet, and Internet use increased over time. Feedback from the usability testing on the length, presentation, and content of the materials was incorporated into the final versions of the booklet and website. Both the feasibility studies and the usability testing highlighted the need to address men's informed decision making regarding screening.

Conclusions

Informed decision making for PCa screening is crucial at present and may be important for some time, particularly if a definitive recommendation either for or against screening does not emerge from ongoing prostate cancer screening trials. We have detailed our efforts at developing print- and web-based DAs to assist men in determining how to best meet their PCa screening preferences. Following completion of our ongoing RCT designed to test these materials, our goal will be to develop a dissemination project for the more effective tool.

Trial Registration

NCT00623090

Background

Prostate cancer (PCa) is the leading cancer diagnosis among men and the second leading cause of male cancer death [1,2]. While research has shown that PCa screening can find cancer at its earliest stages, it is uncertain whether early detection and treatment of PCa leads to a reduction in disease-related mortality [3,4]. Preliminary results from two large randomized controlled cancer screening trials (RCTs) have recently been published [5,6]. While one trial found a 20% reduction in death from PCa as a result of screening [6], findings from the other trial showed no significant reduction in disease-related mortality [5]. Given these inconclusive results, the uncertainties regarding screening continue. The final mortality results from these trials will not be available for several years.

The challenge of making medical decisions prior to the availability of definitive outcome data has been a long-standing issue in cancer screening [7-9] that is likely to become increasingly important as advances in screening technology outpace our ability to validate effectiveness [10-14]. Currently, there is no national standard of care with regard to PCa screening and national medical organizations differ in their screening recommendations [15-21]. However, most recommend that men learn about the pros and cons of PCa screening in order to reach an informed decision [16-19,21]. Thus, widely applicable and easily disseminable approaches to health education are needed [22].

Informed decision making occurs when individuals understand the benefits, risks, alternatives and uncertainties surrounding a medical condition or procedure and are able to use this information in conjunction with their preferences to make a decision that is consistent with those preferences [23]. One approach to promoting informed decisions for PCa screening is the use of patient education materials and decision aids (DAs). The goals of DAs are to foster informed health decisions by: 1) providing facts about the condition and procedures; 2) helping patients to clarify personal preferences and values; and 3) encouraging discussions with medical professionals to guide health decisions that match these preferences [24]. DAs are considered particularly useful when efficacy is unclear, outcomes are uncertain, and/or subjective judgments about benefits and risks are required [24]. Cancer screening-related DAs are particularly important because they have been found to increase cancer-related knowledge without increasing anxiety [25].

Increasingly, cancer screening decision tools have begun to utilize the Internet [26-31]. Despite the digital divide and differences in Internet use among different age and racial groups [32], the percentage of Americans who use the Internet is continuing to grow [33,34]. Internet users who access medical or health information have also increased between 2001 and 2007, from 66% to 76% for those aged 50 to 64 and from 60% to 71% for those over 65 [32]. These trends suggest that the Internet has vast potential as a widely accessible approach to delivering decision support materials for PCa screening.

The most recent systematic review of DAs for PCa screening was published in 2007, which presented the findings of 12 RCTs [35]. While we did not conduct our own systematic review, we used the same Medline search criteria used in Volk's review ('prostate cancer' and 'decision making') to locate RCTs published since the review, between January 2007 and June 2009. We located an additional six trials [27-29,36-38], and thus there have been a total of 18 published RCTs evaluating materials designed to improve informed decision making regarding PCa screening [26-29,36-49]. These trials have assessed print, verbal, Internet, video and interactive computer-based PCa screening DAs. We have provided a summary of these 18 published RCTs (see Additional File 1). Quasi-experimental studies [50-54], abstracts, and studies evaluating DAs designed to increase PCa screening were excluded from our summary. Of the 16 trials that assessed knowledge, all reported a significant improvement. However, inconsistencies were seen among the trials with respect to changes in decisional conflict, screening behavior, intent to screen, and active participation in the screening decision (see Additional File 1).

Although these were well-conducted trials, there were several limitations in the development and evaluation of these DAs. First, only 5 of the 18 studies [27,38,40-42] included a values clarification component to assist men in integrating the information and elucidating their preferences about PCa screening. This may explain why most studies reported only a modest improvement in participants' knowledge, or modest reductions in decisional conflict [27-29,37,40,41,43-46,48]. Second, of the 4 web-based DAs, only one [27] utilized an interactive format, while the other studies with web-based interventions did not exploit the strengths of this medium [26,28,29]. Third, while one web-based tool utilized a tracking mechanism to monitor whether participants viewed the website [27], that study did not determine whether the amount of time spent and topics accessed on the site impacted outcome measures. Fourth, several of the studies reporting pre- and post-intervention evaluations had a brief follow up period of less than 1 month, thereby limiting the understanding of the long-term impact of the interventions on screening behavior and other outcomes [28,38,40,41,43,44]. Finally, only 4 of the RCTs included a substantial number of African American (AA) men, who are at greatest risk for PCa [36,38,42,45].

Our goal was to extend these prior studies by developing two new patient DAs, a booklet and an interactive web-based tool, that could be utilized in a variety of settings. We sought to create widely disseminable and relevant materials that would improve PCa knowledge and assist a heterogeneous population of men in making informed screening decisions. We incorporated a values clarification component into each DA, which is intended to help individuals determine their personal preferences and beliefs about PCa screening and to make informed choices in accordance with those preferences. We are currently conducting a three arm RCT (including a usual care arm) to assess the efficacy of these tools among a diverse sample of men accrued from primary care clinics. This paper describes the development and content of these two DAs, including a description of our prior feasibility studies and randomized trials, each of which contributed to the evolution of these tools.

Methods

Development of Decision Aids

The development of the booklet and website was guided by two print booklets we had previously created and evaluated (Studies 1 and 2). Further, we conducted two feasibility studies and usability testing to confirm the viability of developing and testing a web-based decision tool (Study 3). All studies were approved by the Georgetown University/Medstar Oncology Institutional Review Board.

Study 1- The Right Decision is Yours: A Guide to Prostate Cancer Check-ups

Our initial version of the booklet was developed in collaboration with the Most Worshipful Prince Hall Grand Lodge of the District of Columbia (Masons) and was targeted to AA men and their spouses [55]. We conducted eight focus groups (N = 44) with AA men between the ages of 40 and 70 to determine the target population's informational needs and to guide the content and format of the booklet. We conducted two additional focus groups with internists, family physicians, and urologists to obtain input about factual information to include in the booklet.

Thematic analyses of transcripts of the lay focus groups, along with input from the physicians and guidelines of the Centers for Disease Control and Prevention for the development of educational materials (i.e., clear presentation, logical sequence, ease in understanding, and interesting, familiar, realistic, positive images) aided in the creation of pilot materials [55,56]. We modified the pilot materials based on iterative feedback from focus groups, members of the Prince Hall Masons, and the entire project team.

The end product, completed in May 2000, was a 16-page educational booklet entitled The Right Decision is Yours: A Guide to Prostate Cancer Check-ups and targeted specifically to AA men [55,57]. We found that the print intervention increased knowledge and reduced decisional conflict when compared to videotape and control conditions, and that screening behavior was not associated with either of the interventions [45].

Study 2- Prostate Cancer Screening: Making an Informed Decision

In our next study, we revised the above booklet to target men of all ethnic and racial backgrounds. The additions to the content were adapted from a Centers for Disease Control and Prevention educational tool [58] and provided information about the leading causes of death among men, the accuracy of the prostate-specific antigen (PSA) test, and the treatment decisions that need to be considered when PCa is diagnosed.

Additionally, we included a 10-item values clarification component (adapted from Gattellari and Ward, 2003) [40] to help participants weigh the relative benefits and risks of screening. The balance sheet consisted of five items that addressed the benefits of screening (e.g., "I am worried about PCa and screening may give me peace of mind") and five items that addressed the limitations of screening (e.g., "I do not want to risk finding out I have cancer when it may never bother me"). Participants were asked to consider each item and indicate those 'that sound like you.' The purpose of the exercise was to provide men with a descriptive rather than a prescriptive summary of the screening objectives that were important to them. Their response patterns suggested whether they were leaning toward or away from getting screened.

We conducted 8 usability testing sessions with 3-4 men per session (total N = 29; 74% AA, 22% White, and 4% of Caribbean/West Indian descent; age 40-70). The majority of participants were recruited from fliers posted at Georgetown University Hospital (GUH), Howard University Hospital, the National Prostate Cancer Coalition, and the local fire department. Participants provided feedback on the style and method of presentation of the information to ensure that the booklet addressed relevant topics and that the uncertainty surrounding screening was addressed in a balanced manner. Further, participants gave their opinion of the values clarification component and suggested ways to improve the balance sheet.

Based on the usability testing findings and research team recommendations, a plain language specialist was consulted to ensure that the DA did not exceed an 8^thgrade reading level. The end product, a 24 page booklet entitled Prostate Cancer Screening: Making an Informed Decision, was completed in July, 2004. We evaluated the booklet in a RCT among men who were registered to undergo free screening [59], comparing this booklet to the PSA question and answer fact sheet developed by the National Cancer Institute [60]. Similar to Study 1, exposure to the DA resulted in a significant increase in knowledge and a decrease in decisional conflict but no change in screening behavior.

Study 3- Prostate Cancer Screening: Making the Best Choice

Overview

The development of our final set of materials was conducted in several steps. We conducted two studies to assess the feasibility of an Internet-based PCa screening decision tool. Next, we drafted both the new booklet and the website based on the materials described in Studies 1 and 2. Finally, we conducted usability testing to obtain feedback on our draft materials.

Feasibility Studies

We sought to gain an understanding of our target population's access to and knowledge of the Internet. To do this, we conducted two feasibility studies with men accrued from the primary care clinics at two Washington, DC teaching hospitals, GUH and the Washington Hospital Center (WHC), the accrual sites for the target population in the ongoing RCT. GUH and WHC serve different populations with regard to race/ethnicity and socioeconomic backgrounds. GUH serves a racially diverse and middle to upper-middle class patient population, while WHC serves a largely AA patient population of predominately lower- to middle-class socioeconomic status.

We conducted feasibility studies with patients from both hospitals to determine how our materials should be tailored in order to meet the needs of each group. The feasibility studies were conducted 18 months apart to examine how Internet access and use changed among this population of men over time (January 2005 and June 2006). For each study, men between the ages of 45 and 70 without a previous diagnosis of PCa were accrued from the waiting rooms of the primary care clinics at GUH and WHC. Participants completed a brief survey that contained questions about sociodemographic information, PCa screening knowledge, and typical Internet use (see Table Table11 for the sample description) (See Additional file 2). In the second study, we added the Newest Vital Sign component, a measure of medical literacy, to the questionnaire (See Additional file 3) [61].

Table 1

Feasibility Study 1, January 2005

Development of the Booklet and the Website

The study team and consultants first drafted a new version of the booklet. The primary differences from the prior booklet included both substantive changes (e.g., additional information on screening recommendations, different methods of PSA measurement, and additional figures and statistics) as well as improved readability (e.g., layout changes, improved wording, adding text boxes to highlight main points, greater use of bulleted text, reordering of topics). At each step in the development process, members of our research team, including primary care physicians and researchers specializing in PCa screening education, reviewed and modified drafts of the booklet.

After finalizing the content of the new booklet, we began working with the web developers to design the website prototype. We provided them with both the draft form of the booklet and a list of website features to include or avoid, based on our review of several existing health websites. We sought to create a universally functional site by accommodating varying web-browsers (e.g., Internet Explorer, Safari), using Adobe Flash ™ in the user interface, and using open source development tools to facilitate flexible site maintenance and support. The time required to load pages made the website unsuitable for dial-up connections. However, the results of the second feasibility study confirmed widespread access to high-speed Internet, and we anticipated even greater broadband use after the completion of the randomized trial.

The booklet and website were edited by a plain language expert who provided guidance on the presentation of the information, including the use of parallel sentence construction, bolded headers and sub-headers to alert readers to changes in topic, the use of bulleted text and tabs on the right edge of the pages, and the inclusion of a detailed glossary that defined medical terms often misunderstood by laypersons. The presentation of content on the website was designed to improve its appeal to persons who may not be regular web-users. We omitted sections of text to increase readability and wrote the materials in the conditional tense to prevent the reader from misinterpreting the information. Importantly, we acknowledged men's uncertainty surrounding screening in an effort to help them consider information that conflicted with their prior beliefs. Both the booklet and the website were written at or below an 8^thgrade reading level based on the Fleish-Kincaid grade level formula [62].

The development of these materials was also guided by criteria from the International Patient Decision Aid Standards (IPDAS) Collaboration, a worldwide group of health-care practitioners and researchers who have developed standards for DAs [63]. IPDAS standards help researchers create DAs to prepare patients to have conversations with their physicians about medical tests and procedures [64].

Booklet Usability testing

We recruited participants (N = 14) from GUH and WHC primary care clinic waiting rooms, from fliers placed in surrounding neighborhoods, and from a General Education Development center to ensure inclusion of men with limited literacy. Men were eligible if they were 45-70 years old and had not had PCa. Participants reviewed the booklet in our research offices (N = 6), as well as the clinic waiting room (N = 7) and their own home (with follow-up to discuss his feedback; N = 1) in order to accommodate their schedules.

At the start of each session, one to two members of the research team held a brief discussion with participants regarding their prior experiences with screening to ensure that no one had had unusual experiences that would impact their feedback. Participants then individually reviewed the booklet and completed a brief questionnaire concerning their opinions of the DA, their overall health, and demographic information (See Additional file 4). Moderators noted participants' recommendations for modifications to the text, graphs, figures, and their impressions of the overall message of the DA.

Our intention was not to conduct traditional qualitative analyses, as we had previously done in Study 1 [55]. The majority of the content was decided upon from the previous versions of our materials and through updates gained from the CDC [58]. We conducted the usability testing to assess men's reactions to the presentation of the materials. The usability testing concluded with a brief questionnaire that inquired about men's opinions of the materials and demographic information.

Website Usability testing

Participants for the usability testing were again recruited from GUH and WHC primary care clinics. Usability testing of the website involved the same recruitment method and protocol described above for the booklet usability testing. However, all but one session was conducted in our research offices. Following the consent process, we provided an explanation of the rationale for the website and then asked participants to individually review the proposed website content. As in the booklet usability testing, website usability testing sessions were not recorded. However, one to three members of the research team observed each participant during the review process to look for navigation and usability issues and take note of verbal comments made by participants. The meetings ended with an informal discussion and a questionnaire to assess participants' thoughts, likes, and dislikes of the materials (See Additional file 5).

Results

Feasibility Studies

Sample

For the initial feasibility study (January 2005), 55/58 (95%) men agreed to participate. The mean age of participants was 54.7 (SD = 7.6), with a little over half of the men reporting that they were AA (Table (Table11).

The second feasibility study (June 2006) had a participation rate of 83% (99/119). The sociodemographic characteristics of these participants were virtually identical to that of the first feasibility study (see Table Table2),2), with a mean age of participants of 54.6 (SD = 7.4) and just over half AA.

Table 2

Feasibility Study 2, June 2006

Results

Responses to the first feasibility study indicated that, regarding PCa screening knowledge, 97.1% of men at GUH and 85.7% at WHC endorsed the belief that 'experts agree that all men should be tested for PCa.' This suggested a lack of understanding of the uncertainties surrounding screening. Overall, the majority of men with Internet access at home or work reported accessing the Internet a few times a week or daily (82.9%). Further, 79.3% of all men indicated they would 'probably' or 'definitely' read information about PCa on the Internet. We did not compare the two sites for statistically significant differences as the goal was simply to describe the men present at each site.

In the second feasibility study, a majority of men reported having Internet access at home or work (70.7%), and just over half reported preferring to receive health related information on the Internet (53.8%). The mean total score for the Newest Vital Sign scale was 3.9 (SD = 2.0) at GUH and 1.9 (SD = 1.8) at WHC. Scores on the Newest Vital Sign scale range from 0 to 6, with fewer than four correct answers indicating the possibility of limited literacy.

The feasibility studies identified the need for educational tools to improve men's knowledge of the uncertainties surrounding PCa screening. Responses to the Internet access and use questions confirmed that the Internet was a feasible medium for a widely accessible PCa screening educational tool. Although these were not representative samples, the data suggest that a majority of men had access to the Internet, and this access was sustained over time. These results further supported and gave us confidence in our decision to create a website that used a broadband Internet connection (as opposed to a dial-up connection) in order to deliver more complex interactive and video features. Participants' scores on the Newest Vital Sign reinforced the need for a plain language specialist in developing text for the website and the booklet.

Booklet Usability testing

Sample

The mean age of participants (N = 14) was 53.8 (SD = 7.8). Half of the men were unemployed or retired and 71.4% were AA. Additional demographic information for these participants is presented in Table Table3.3. Given the overlap between the groups of men who reviewed the booklet and the website (N = 6 reviewed both), we did not assess the potential differences between the two groups.

Table 3

Evaluation Data from Usability testing (Study 3)†

Results

Responses to the questionnaire are presented in Table Table3.3. Half of the men reviewing the booklet indicated that it had about the right amount of information and was about the right length, but a substantial minority reported that it contained more information than they would have liked (42.8%) or was too long (35.7%). Despite our efforts to provide balanced information, a majority of men (71.5%) said that the overall message of the booklet was that they should probably or definitely get screened for PCa. Many participants indicated that they were unaware of the uncertainty surrounding PCa screening. This suggested that a single discussion of the uncertainty was not enough to impact men's understandings of this complex topic.

In general, men were positive about the booklet, but many provided suggestions for information they would like to have added (Table (Table4);4); the content and layout of the booklet were revised accordingly. For example, the values clarification component presented in the Study 2 booklet, containing a non-prescriptive balance sheet, was simplified based on feedback from usability testing participants (see Figure Figure1).1). Participants were asked to select which of 10 statements 'sound like you,' with five highlighting the benefits of screening and five highlighting limitations. Participants' responses were intended to indicate whether they leaned toward or away from screening. Because many men found the original questions to be complex, we tested multiple versions of the questions.

Table 4

Feedback and Subsequent Changes from Usability testing (Study 3)

Figure 1

Booklet Values Clarification Component (Adapted from Gattellari & Ward (2003)[40].

Table Table55 summarizes the booklet content and discusses the similarities and differences between the booklet and the web-based DA. We maintained consistency between the content of the booklet and website but note differences related to the interactive features of the web-based tool.

Table 5

Comparison of the Booklet and Web-based Educational Tools (Study 3)

Website Usability testing

Sample

Overall, 14 men reviewed the website, six of whom had previously reviewed the booklet. The mean age of participants was 54.0 (SD = 7.2). Despite the small sample size, half of the participants were AA and half were employed. Additional demographic information for these participants is presented in Table Table33.

Results

Based on the questionnaire data, one-half (50%) of the men said the site provided about the right amount of information and 42.9% said it was about the right length. Despite our efforts to ensure a balanced presentation of the issues, only 35.7% indicated that the website's overall message neither favored nor opposed PCa screening. Although far short of our goals, this was an improvement over our prior decision tools and over the current booklet (see Table Table3).3). Anecdotal information suggested that this viewpoint may be most prevalent among men who were screened regularly, as they may have taken note of the benefits of screening more so than the limitations. Table Table44 describes revisions made to the website based on usability testing feedback. Changes related to content were made to both the website and booklet.

A primary concern during website development was whether men with little or no computer experience could successfully use the site. Based on difficulties experienced by three participants with little to no computer experience, several necessary modifications were made to the site to make it more user-friendly (Table (Table4).4). Difficulties in site navigation would have been overlooked if only computer savvy men had been sampled. While some men initially had trouble using the website, they were all ultimately able to successfully navigate the site and understand its content after viewing printed instructions.

Based on usability testing and recommendations from the research team, the web developers created several iterations of the website before a release candidate was created, approved, and launched. The website required 30-50 minutes to review and had a literacy level that did not exceed an eighth grade reading level. Importantly, the website aimed to present information in a balanced manner, neither encouraging nor discouraging screening. The web developers continue to provide ongoing technical support to ensure that team members and study participants do not encounter difficulties using the website.

Table Table55 also provides details on the nine topic areas presented in the website as well as the booklet, including content features, similarities and differences with regard to the presentation of information, as well as a description of how general features differ between the two formats (e.g., audio vs. text, graphics). The final versions of the booklet and website, entitled Prostate Cancer Screening: Making the Best Choice, were completed in October 2007. The remainder of the Results section is devoted to the description of specific interactive features of the website.

Components of the Website

The interactive features of the website enabled an expansion and customization of the material. For example, web-users could access additional external information (e.g., the resource page included links to the homepages of national organizations that provide more information on PCa screening and treatments) or could use the table of contents to easily navigate to other sections of interest.

The website was made more accessible to men with limited literacy by presenting the majority of the text via voice over. Audio was available for approximately 70% of the text, and 80% of the audio matched the text verbatim. Users could deactivate the audio if they preferred to only read text.

The website included eight testimonials, prepresented as video clips of men speaking about their screening decision, whereas the booklet included written quotations from two men (one pro, one con). The videos enabled users to view the emotional reactions and facial expressions of the different actors as they relayed personal stories about PCa screening. We utilized actors that represented a racially diverse group of men in an effort to help make the information more relevant and understandable [31]. Of the eight video testimonials presented, 3 of the actors were AA, two were white, one was Asian, one was Native American, and one was Hispanic.

The interactive nature of the website insured that users were exposed to a perspective about PCa screening that differed from their own, in an effort to address the presence of a confirmation bias [65]. To do this, users indicated their history of screening, which was assessed upon entry into the website. The first two video testimonials were tailored so that a user who was leaning toward screening first viewed two testimonials of men who chose not to get screened, and vice versa for men leaning against screening. In subsequent sections of the website, the remaining six testimonials (3 pro, 3 con) were presented back to back so that everyone viewed all 3 pairs. The race of the actors varied so that the pro and con messages were delivered by actors of different races.

The 10-item values clarification component described above for the booklet was also included on the website in an interactive format (Figure (Figure2).2). Individual items were presented at the end of different content sections and users were prompted to respond: 'sounds like me,' 'does not sound like me 'or 'not sure yet.' Questions that men skipped as they navigated through the site were automatically entered as 'not sure yet.' The questions were displayed again at the end of the website to provide men with an opportunity to change the response. Responses to all items were then depicted on a balance scale to help men determine if they leaned toward or away from getting screened. Finally, users always received a prompt to review the values clarification tool upon exiting the website; thus, it was seen by all men, even those who did not review the entire website.

Figure 2

Website Values Clarification Component (Adapted from Gattellari & Ward (2003))[40].

The web-based format also allowed for animation and graphics to draw attention to key points and direct the user through the website. For example, a graphic of 100 men that illustrated the accuracy of the PSA test changed colors to distinguish subgroups from the whole and was accompanied by a voiceover that explained the figure (Figure (Figure3).3). The booklet, however, provided a single tree diagram to depict the same statistics (Figure (Figure44).

Figure 3

Website Screenshot of Animation Depicting the Accuracy of the PSA Test [83-85].

Figure 4

Booklet Depiction of the Accuracy of the PSA Test [83-85].

Finally, the website is capable of tracking men's use of the materials and provides data on the behaviors of visitors. Data stored in a password protected Structured Query Language database provides records of the time spent visiting the website, time spent in each section, and responses to the DA queries. Upon completion of the RCT, this information will help determine whether initial screening preferences and usage patterns are associated with knowledge acquisition, decisional conflict, baseline screening preference, and subsequent screening decisions.

Discussion

There is considerable interest in assisting men with PCa screening decisions, as evidenced by the 18 RCTs conducted to assess the efficacy of DAs. We sought to address several limitations of the previous studies with the development of two disseminable tools with extensive formative evaluations: a print booklet and an interactive website. The booklet and the website offer the identical content, while the website also includes an interactive values clarification component, video testimonials, and tracking software to assess men's utilization of the website. The website recently received the 2009 American Public Health Association's award for Public Health Education Materials [66]. Our ongoing RCT will examine the impact of the website and booklet on PCa screening knowledge, decisional conflict, satisfaction with decision, health-related quality of life and screening behaviors. The trial will be completed in 2011.

Our new materials offer several improvements over prior DAs. Given the persistent problem created by the digital divide, regarding both limited access and preferentially attracting Internet-savvy users, we designed features of the website to appeal to more diverse groups. Our formative work and prior randomized trials included a large number of AA participants as well as participants from diverse socioeconomic backgrounds, which provided insights to design materials for these groups. For example, our DAs maintained a maximum of an 8^thgrade reading level, information was provided in plain language, and a glossary defined terms used throughout the website and booklet. Further, we incorporated visuals, graphs and charts, all of which have been suggested as methods for increasing comprehension among low-literacy groups [31].

In addition to making the materials appealing and understandable to diverse groups of men, we also assessed the extent of web access within our target sample. We found that over an 18-month period, web usage among lower socioeconomic men had increased. These results are consonant with some findings from the Pew Foundation [67], although other studies have reported slower growth among low SES and minority groups [68]. Our ongoing trial will provide more definitive evidence regarding the impact of web- vs. print-based media for PCa screening education, as well as the extent to which we managed to bridge the digital divide. The testing of these DAs among minorities and low literacy participants will provide an important opportunity to validate effectiveness in this population, which tends to be less informed about screening options and less engaged in decision-making [69,70].

To our knowledge, ours is the second study to describe an interactive web-based tool designed to educate men about PCa screening [27], and the first to utilize tracking software to compare website utilization patterns with patient outcomes. Potential advantages of using web-based materials include the relatively low cost of updating information and the increased capability of tailoring and interactivity, which may assist in the acquisition and integration of knowledge. For example, by tailoring the presentation of the first two video testimonials in response to the user's baseline screening preference, we have insured that men consider counterarguments to help balance their perspective. Also, the interactive nature of the web-based values clarification exercise was designed to actively engage participants and enhance the integration of knowledge. This was intended to help men make a decision that corresponds more closely with their own values and screening preferences, decrease decisional conflict, and increase decisional satisfaction.

Over the course of the development of these DAs, we have encountered several important issues that may be useful to others who are creating similar tools. First, there was a tradeoff between providing detailed information vs. risking that the materials would require more time than men would be willing to devote to them. Despite our best efforts to be concise, between 35% (booklet) and 50% (website) of the usability testing participants thought the materials were too long. As we did not want to exclude any pertinent information, it is possible that the length of our materials may deter some men from reading all of the text. However, with both the booklet and the website, we expect that men will selectively access sections of interest by using the Table of Contents.

Secondly, when we conducted our web usability testing, we provided a step-by-step instruction sheet for using the website. Men reported that the instructions were very helpful, particularly for those with less computer experience. Due to these findings, as well as what we know about the disparities between SES groups and Internet use, we have included the instruction sheet in the current randomized trial to ensure that men with less experience using the Internet will be able to successfully access and use our materials.

Finally, it was challenging to develop a DA that addressed the uncertainty of a screening test for men who had been undergoing regular screening and who were completely unaware of the uncertainty. The balancing act was to validate what men already knew while also providing information that was both counterintuitive and contrary to their previous impression. We worked to present the materials in an evenhanded fashion; however, results from the usability testing suggested that only a minority of men thought the booklet (14%) and website (36%) neither endorsed nor opposed screening. These findings highlight the fact that it may take more than a single exposure to materials such as ours for patients to grasp a message that is both complex and counter to one's current understanding and practices. While our usability testing provided critical information during the development process and our sample size was comparable to other studies involving usability testing [71,72], a larger sample may have provided the feedback necessary to more effectively present the uncertainty and the message of neither endorsing nor opposing screening.

Conclusion

Despite the uncertainty surrounding PCa screening, most primary care physicians routinely order the PSA test for men over 50, and some engage in unsupported practices, such as screening patients over age 75 and referring such men for biopsies when PSA values are elevated [73-75]. Due to the logistic constraints they face [76], many physicians administer PCa screening with little opportunity to discuss the test beforehand [77]. However, evidence indicates that many men would prefer to make a shared PCa screening decision in conjunction with their physicians [78-81]. Consequently, access to an effective DA in the primary care setting may promote shared decisions among large numbers of men in the decisive period before testing occurs. In 2005, 80% of males had at least one visit with an ambulatory care physician [82], suggesting that an intervention implemented in this setting could have a widespread impact.

Providing assistance for informed decision making for PCa screening may be important for some time, particularly if a definitive recommendation either for or against screening does not emerge from the ongoing screening trials. We have detailed our efforts at developing print- and interactive web-based DAs to assist men in determining whether they prefer to be screened or not. Given that technological advances in medical screening tests will continue to occur faster than clinical translational research can keep pace, we hope that insights from the development of our decision tools will be applicable as other screening dilemmas arise.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

CD took the lead role in the writing and editing of the manuscript, as well as in usability testing recruitment. RW administered the questionnaires for the first feasibility study and participated in drafting the manuscript. EK participated in drafting the manuscript and in data analysis. SR participated in drafting the manuscript, conducting usability testing, and data analysis. DD recruited participants, conducted usability testing, and participated in data analysis. WT participated in drafting the manuscript. EP recruited participants, conducted usability testing, and participated in data analysis. J O-F was the plain language consultant during the iterative development process and provided multiple edits to both the layout and the wording of the text. KD, AK, SW, and MS participated in drafting the manuscript and reviewing and editing the materials during the iterative process. MF provided access to the primary care clinic in which men were recruited for the feasibility studies and usability testing, as well as drafting the manuscript and reviewing the materials during the iterative process. CC provided access to the primary care clinic in which men were recruited for the feasibility studies and usability testing, as well as drafting the manuscript and reviewing the materials during the iterative process. KLT conceived the project, is the Principal Investigator of the NCI and DoD grants which have funded this project, edited and reviewed the materials during the iterative process, and participated in writing the manuscript. All authors read and approved the final manuscript.

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1472-6947/10/12/prepub

Supplementary Material

Additional file 1

Appendix A. Outcomes of Randomized Controlled Trials of Prostate Cancer Screening Decision Aids

Click here for file^{(95K, DOC)}

Additional file 2

Supp File 2. Pilot Screening and Internet Usage Questionnaire-Feasibility Study 1 - January 2005

Click here for file^{(68K, PDF)}

Additional file 3

Supp File 3. Pilot Screening and Internet Usage Questionnaire-Feasibility Study 2 - June 2006

Click here for file^{(160K, PDF)}

Additional file 4

Supp File 4. Booklet Usability Testing Questionnaire

Click here for file^{(39K, PDF)}

Additional file 5

Supp File 5. Website Usability Testing Questionnaire

Click here for file^{(38K, PDF)}

Acknowledgements

We thank Cheryl Manning and Catherine Swinson of Triad Interactive, Inc. for their work on creating the website. We also thank Susan Spangler for her work on the layout and design of the booklet.

Funding: This work was supported by grants from the National Cancer Institute, Bethesda, MD, USA (#1ROI CA119168-01) and the Department of Defense, Fort Detrick, MD, USA (No. W81XWH-06-1-0182). The funding sources for this study did not play an active role in the design of the study, collection, analysis, interpretation of data or writing of this manuscript.

References

American Cancer Society. Cancer Facts and Figures 2009. http://www.cancer.org/downloads/STT/500809web.pdf
Jemal A, Siegel R, Ward E, Hao Y, Xu J, Thun MJ. Cancer Statistics, 2009. CA Cancer J Clin. 2009;59:225–249. doi: 10.3322/caac.20006. [PubMed] [Cross Ref]
Ries LAG, Melbert D, Krapcho M, Stinchcomb DG, Howlader N, Horner MJ. SEER Cancer Statistics Review. National Cancer Institute. Bethesda, MD; 1975. http://seer.cancer.gov/csr/1975_2005/ based on November 2007 SEER data submission, posted to the SEER web site 2008.
Stanford JL, Stephenson RA, Coyle LM, Cerhan J, Correa R, Eley JW. Prostate Cancer Trends 1973-1995. SEER Program, National Cancer Institute. NIH publication; 1999. pp. 99–4543.
Andriole GL, Crawford ED, Grubb RLI, Buys SS, Chia D, Church TR. Mortality results from a randomized prostate-cancer screening trial. N Engl J Med. 2009;360:1310–1319. doi: 10.1056/NEJMoa0810696. [PMC free article] [PubMed] [Cross Ref]
Schroder FH, Hugosson J, Roobol MJ, Tammela TL, Ciatto S, Nelen V. Screening and prostate-cancer mortality in a randomized European study. N Engl J Med. 2009;360:1320–1328. doi: 10.1056/NEJMoa0810084. [PubMed] [Cross Ref]
Collins MM, Barry MJ. Controversies in prostate cancer screening. Analogies to the early lung cancer screening debate. JAMA. 1996;276:1976–1979. doi: 10.1001/jama.276.24.1976. [PubMed] [Cross Ref]
Laara E, Day NE, Hakama M. Trends in mortality from cervical cancer in the Nordic countries: association with organised screening programmes. Lancet. 1987;1:1247–1249. [PubMed]
Woolf SH, Lawrence RS. Preserving scientific debate and patient choice: lessons from the Consensus Panel on Mammography Screening. National Institutes of Health. JAMA. 1997;278:2105–2108. doi: 10.1001/jama.278.23.2105. [PubMed] [Cross Ref]
Brawley OW, Kramer BS. Cancer screening in theory and in practice. J Clin Oncol. 2005;23:293–300. doi: 10.1200/JCO.2005.06.107. [PubMed] [Cross Ref]
Curry SJ, Byers T, Hewitt MA. , National Cancer Policy Board, Institute of Medicine, National Research Council. Fulfilling the Potential of Cancer Prevention and Early Detection. Washington, DC: National Academies Press; 2003.
Mahadevia PJ, Fleisher LA, Frick KD, Eng J, Goodman SN, Powe NR. Lung cancer screening with helical computed tomography in older adult smokers: a decision and cost-effectiveness analysis. JAMA. 2003;289:313–322. doi: 10.1001/jama.289.3.313. [PubMed] [Cross Ref]
Ornstein DK, Rayford W, Fusaro VA, Conrads TP, Ross SJ, Hitt BA. Serum proteomic profiling can discriminate prostate cancer from benign prostates in men with total prostate specific antigen levels between 2.5 and 15.0 ng/ml. J Urol. 2004;172:1302–1305. doi: 10.1097/01.ju.0000139572.88463.39. [PubMed] [Cross Ref]
Watson RW, Schalken JA. Future opportunities for the diagnosis and treatment of prostate cancer. Prostate Cancer Prostatic Dis. 2004;7(Suppl 1):S8–S13. doi: 10.1038/sj.pcan.4500742. [PubMed] [Cross Ref]
American Academy of Family Physicians. Summary of Recommendations for Clinical Preventive Services. Revision: 6.8. 2009. http://www.aafp.org/online/etc/medialib/aafp_org/documents/clinical/CPS/rcps08-2005.Par.0001.File.tmp/CPSapprovedApril2009.pdf
American Cancer Society. Overview: Prostate Cancer. Atlanta, GA: American Cancer Society; 2009. http://www.cancer.org/docroot/CRI/content/CRI_2_2_3X_How_is_prostate_cancer_found_36.asp?sitearea
American College of Physicians. Clinical Guideline: Part III: Screening for Prostate Cancer. Ann Intern Med. 1997;126:480–484. [PubMed]
American Medical Association. Annual meeting of the American Medical Association: Reports of the Council on Scientific Affairs. Chicago, IL. 2000. http://www.ama-assn.org/ama1/pub/upload/mm/443/csaa-00.pdf
American Urological Association Education and Research Inc. Prostate-Specific Antigen Best Practice Statement. American Urological Association: 2009 Update. 2009. http://www.auanet.org/content/guidelines-and-quality-care/clinical-guidelines/main-reports/psa09.pdf
Lim LS, Sherin K. Screening for prostate cancer in U.S. men ACPM position statement on preventive practice. Am J Prev Med. 2008;34:164–170. doi: 10.1016/j.amepre.2007.10.003. [PubMed] [Cross Ref]
U.S.Preventive Services Task Force (USPSTF) AHRQ publication 08-05121-EF-2. Agency for Healthcare Research and Quality, Rockville, MD; 2008. Screening for Prostate Cancer: Recommendations and Rationale.http://www.ahrq.gov/clinic/uspstf08/prostate/prostaters.htm
Chapman GB, Sonnenberg FA. In: Decision Making in Health Care: Theory, Psychology, and Applications. Chapman GB, Sonnenberg FA, editor. New York: Cambridge University Press; 2000. Introduction; pp. 3–19.
Rimer BK, Briss PA, Zeller PK, Chan EC, Woolf SH. Informed decision making: what is its role in cancer screening? Cancer. 2004;101:1214–1228. doi: 10.1002/cncr.20512. [PubMed] [Cross Ref]
O'Connor AM, Elwyn G, Barratt A, Barry M, Coulter A, Holmes-Rovner M. International Patient Decision Aid Standards (IPDAS) Collaboration. Criteria for Judging the Quality of Patient Decision Aids. 2005. http://ipdas.ohri.ca/IPDAS_checklist.pdf
O'Brien MA, Whelan TJ, Villasis-Keever M, Gafni A, Charles C, Roberts R. Are cancer-related decision aids effective? A systematic review and meta-analysis. J Clin Oncol. 2009;27:974–985. doi: 10.1200/JCO.2007.16.0101. [PubMed] [Cross Ref]
Frosch DL, Kaplan RM, Felitti VJ. A randomized controlled trial comparing internet and video to facilitate patient education for men considering the prostate specific antigen test. J Gen Intern Med. 2003;18:781–787. doi: 10.1046/j.1525-1497.2003.20911.x. [PMC free article] [PubMed] [Cross Ref]
Frosch DL, Bhatnagar V, Tally S, Hamori CJ, Kaplan RM. Internet patient decision support: a randomized controlled trial comparing alternative approaches for men considering prostate cancer screening. Arch Intern Med. 2008;168:363–369. doi: 10.1001/archinternmed.2007.111. [PubMed] [Cross Ref]
Ilic D, Egberts K, McKenzie JE, Risbridger G, Green S. Informing men about prostate cancer screening: a randomized controlled trial of patient education materials. J Gen Intern Med. 2008;23:466–471. doi: 10.1007/s11606-007-0466-z. [PMC free article] [PubMed] [Cross Ref]
Krist AH, Woolf SH, Johnson RE, Kerns JW. Patient education on prostate cancer screening and involvement in decision making. Ann Fam Med. 2007;5:112–119. doi: 10.1370/afm.623. [PubMed] [Cross Ref]
Ruffin MT, Fetters MD, Jimbo M. Preference-based electronic decision aid to promote colorectal cancer screening: results of a randomized controlled trial. Prev Med. 2007;45:267–273. doi: 10.1016/j.ypmed.2007.07.003. [PubMed] [Cross Ref]
Thomson MD, Hoffman-Goetz L. Readability and cultural sensitivity of web-based patient decision aids for cancer screening and treatment: a systematic review. Med Inform Internet Med. 2007;32:263–286. doi: 10.1080/14639230701780408. [PubMed] [Cross Ref]
Pew Internet and American Life Project. Derived From Trends--Usage Over Time. http://www.pewinternet.org/Static-Pages/Trend-Data/Usage-Over-Time.aspx
Fox S. , Pew Internet American Life Project. Digital Divisions: There are clear differences among those with broadband connections, dial-up connections, and no connections at all to the internet. http://www.pewinternet.org/~/media//Files/Reports/2005/PIP_Digital_Divisions_Oct_5_2005.pdf.pdf
U.S.Department of Commerce, Economics and Statistics Administration, National Telecommunications and Information Administration. A Nation Online: how Americans are expanding their use of the Internet. http://www.ntia.doc.gov/ntiahome/dn/anationonline2.pdf
Volk RJ, Hawley ST, Kneuper S, Holden EW, Stroud LA, Cooper CP. Trials of decision aids for prostate cancer screening: a systematic review. Am J Prev Med. 2007;33:428–434. doi: 10.1016/j.amepre.2007.07.030. [PubMed] [Cross Ref]
Kripalani S, Sharma J, Justice E, Justice J, Spiker C, Laufman LE. Low-literacy interventions to promote discussion of prostate cancer: a randomized controlled trial. Am J Prev Med. 2007;33:83–90. doi: 10.1016/j.amepre.2007.03.018. [PMC free article] [PubMed] [Cross Ref]
Stamatiou K, Skolarikos A, Heretis I, Papadimitriou V, Alevizos A, Ilias G. Does educational printed material manage to change compliance with prostate cancer screening? World J Urol. 2008;26:365–373. doi: 10.1007/s00345-008-0258-z. [PubMed] [Cross Ref]
Volk RJ, Jibaja-Weiss ML, Hawley ST, Kneuper S, Spann SJ, Miles BJ. Entertainment education for prostate cancer screening: a randomized trial among primary care patients with low health literacy. Patient Educ Couns. 2008;73:482–489. doi: 10.1016/j.pec.2008.07.033. [PMC free article] [PubMed] [Cross Ref]
Davison BJ, Kirk P, Degner LF, Hassard TH. Information and patient participation in screening for prostate cancer. Patient Educ Couns. 1999;37:255–263. doi: 10.1016/S0738-3991(98)00123-2. [PubMed] [Cross Ref]
Gattellari M, Ward JE. Does evidence-based information about screening for prostate cancer enhance consumer decision-making? A randomised controlled trial. J Med Screen. 2003;10:27–39. doi: 10.1258/096914103321610789. [PubMed] [Cross Ref]
Gattellari M, Ward JE. A community-based randomised controlled trial of three different educational resources for men about prostate cancer screening. Patient Educ Couns. 2005;57:168–182. doi: 10.1016/j.pec.2004.05.011. [PubMed] [Cross Ref]
Myers RE, Daskalakis C, Cocroft J, Kunkel EJ, Delmoor E, Liberatore M. Preparing African-American men in community primary care practices to decide whether or not to have prostate cancer screening. J Natl Med Assoc. 2005;97:1143–1154. [PMC free article] [PubMed]
Partin MR, Nelson D, Radosevich D, Nugent S, Flood AB, Dillon N. Randomized trial examining the effect of two prostate cancer screening educational interventions on patient knowledge, preferences, and behaviors. J Gen Intern Med. 2004;19:835–842. doi: 10.1111/j.1525-1497.2004.30047.x. [PMC free article] [PubMed] [Cross Ref]
Schapira MM, VanRuiswyk J. The effect of an illustrated pamphlet decision-aid on the use of prostate cancer screening tests. J Fam Pract. 2000;49:418–424. [PubMed]
Taylor KL, Davis JL, Turner RO, Johnson L, Schwartz MD, Kerner JF. Educating African American men about the prostate cancer screening dilemma: a randomized intervention. Cancer Epidemiol Biomarkers Prev. 2006;15:2179–2188. doi: 10.1158/1055-9965.EPI-05-0417. [PubMed] [Cross Ref]
Volk RJ, Spann SJ, Cass AR, Hawley ST. Patient education for informed decision making about prostate cancer screening: a randomized controlled trial with 1-year follow-up. Ann Fam Med. 2003;1:22–28. doi: 10.1370/afm.7. [PubMed] [Cross Ref]
Watson E, Hewitson P, Brett J, Bukach C, Evans R, Edwards A. Informed decision making and prostate specific antigen (PSA) testing for prostate cancer: a randomised controlled trial exploring the impact of a brief patient decision aid on men's knowledge, attitudes and intention to be tested. Patient Educ Couns. 2006;63:367–379. doi: 10.1016/j.pec.2006.05.005. [PubMed] [Cross Ref]
Wilt TJ, Paul J, Murdoch M, Nelson D, Nugent S, Rubins HB. Educating men about prostate cancer screening. A randomized trial of a mailed pamphlet. Eff Clin Pract. 2001;4:112–120. [PubMed]
Wolf AM, Nasser JF, Wolf AM, Schorling JB. The impact of informed consent on patient interest in prostate-specific antigen screening. Arch Intern Med. 1996;156:1333–1336. doi: 10.1001/archinte.156.12.1333. [PubMed] [Cross Ref]
Berglund G, Nilsson S, Nordin K. Intention to test for prostate cancer. Eur J Cancer. 2005;41:990–997. doi: 10.1016/j.ejca.2005.01.011. [PubMed] [Cross Ref]
Ellison GL, Weinrich SP, Lou M, Xu H, Powell IJ, Baquet CR. A randomized trial comparing web-based decision aids on prostate cancer knowledge for African-American men. J Natl Med Assoc. 2008;100:1139–1145. [PubMed]
Flood AB, Wennberg JE, Nease RF Jr, Fowler FJ Jr, Ding J, Hynes LM. The importance of patient preference in the decision to screen for prostate cancer. Prostate Patient Outcomes Research Team. J Gen Intern Med. 1996;11:342–349. doi: 10.1007/BF02600045. [PubMed] [Cross Ref]
Frosch DL, Kaplan RM, Felitti V. The evaluation of two methods to facilitate shared decision making for men considering the prostate-specific antigen test. J Gen Intern Med. 2001;16:391–398. doi: 10.1046/j.1525-1497.2001.016006391.x. [PMC free article] [PubMed] [Cross Ref]
Ruthman JL, Ferrans CE. Efficacy of a video for teaching patients about prostate cancer screening and treatment. Am J Health Promot. 2004;18:292–295. [PubMed]
Taylor KL, Turner RO, Davis JL, Johnson L, Schwartz MD, Kerner J. Improving knowledge of the prostate cancer screening dilemma among African American men: an academic-community partnership in Washington, DC. Public Health Rep. 2001;116:590–598. [PMC free article] [PubMed]
AMC Cancer Research Center. Beyond the Brochure: Alternative Approaches to Effective Health Communication. Atlanta, GA: CDC; 1994. http://www.cdc.gov/cancer/nbccedp/pdf/amcbeyon.pdf
Georgetown University Medical Center, The Most Worshipful Prince Hall Grand Lodge of the District of Columbia. The Right Decision is Yours: A Guide to Prostate Cancer. Funded by the U.S. Centers for Disease Control and Prevention, Cooperative Agreement #TS-290 and the National Cancer Institute, #KO7 CA72645. 2000. http://lombardi.georgetown.edu/pdf/community/prostate_screening_handbook.pdf
U.S. Department of Health and Human Services, Centers for Disease Control and Prevention (CDC) Prostate Cancer Screening: A Decision Guide. 2006. http://www.cdc.gov/cancer/Prostate/pdf/prosguide.pdf
Taylor KL, Schwartz M, Davis K, Zincke N, Williams R, Dawson D. Prostate cancer screening: fostering informed decisions. Presented at the Society of Behavioral Medicine annual meeting, Washington, DC; 2007.
National Cancer Institute, U.S. National Institutes of Health. Prostate-Specific Antigen (PSA) Test. Questions and Answers. 2009. http://www.cancer.gov/cancertopics/factsheet/Detection/PSA
Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med. 2005;3:514–522. doi: 10.1370/afm.405. [PubMed] [Cross Ref]
Friedman DB, Hoffman-Goetz L. A systematic review of readability and comprehension instruments used for print and web-based cancer information. Health Educ Behav. 2006;33:352–373. doi: 10.1177/1090198105277329. [PubMed] [Cross Ref]
Elwyn G, O'Connor A, Stacey D, Volk R, Edwards A, Coulter A. Developing a quality criteria framework for patient decision aids: online international Delphi consensus process. BMJ. 2006;333:417. doi: 10.1136/bmj.38926.629329.AE. [PMC free article] [PubMed] [Cross Ref]
O'Connor AM. Ottawa Decision Support Framework to Address Decisional Conflict. 2006. http://decisionaid.ohri.ca/docs/develop/ODSF.pdf
Redelmeier DA, Rozin P, Kahneman D. Understanding patients' decisions. Cognitive and emotional perspectives. JAMA. 1993;270:72–76. doi: 10.1001/jama.270.1.72. [PubMed] [Cross Ref]
Williams RM, Dorfman CS, Kassan EC, Red S, Dawson DL, Tuong W. Public Health Education and Health Promotion. Award winning health education and promotion materials presentation. American Public Health Association annual meeting; 2009. Prostate Cancer Screening: Making the Best Choice.
Horrigan JB. , Pew Internet American Life Project. Trends in Internet Adoption and Use: Comparing Minority Groups. 2004. http://www.pewinternet.org/Presentations/2004/Trends-in-Internet-Adoption-and-Use.aspx
Horrigan JB. , Pew Internet American Life Project. Home Broadband Adoption. 2008. http://pewresearch.org/pubs/888/home-broadband-adoption-2008
Lillie SE, Brewer NT, O'Neill SC, Morrill EF, Dees EC, Carey LA. Retention and use of breast cancer recurrence risk information from genomic tests: the role of health literacy. Cancer Epidemiol Biomarkers Prev. 2007;16:249–255. doi: 10.1158/1055-9965.EPI-06-0525. [PubMed] [Cross Ref]
Miller DP Jr, Brownlee CD, McCoy TP, Pignone MP. The effect of health literacy on knowledge and receipt of colorectal cancer screening: a survey study. BMC Fam Pract. 2007;8:16. doi: 10.1186/1471-2296-8-16. [PMC free article] [PubMed] [Cross Ref]
Health and Human Services Dept. Research-Based Web Design & Usability Guidelines. 2006. http://www.usability.gov/refine/learnusa.html
Stoddard JL. The importance of usability testing in the development of an internet-based smoking cessation treatment resource. Nicotine and Tobacco Research. 2006;8:S87–S93. doi: 10.1080/14622200601048189. [PubMed] [Cross Ref]
Fowler FJ Jr, Bin L, Collins MM, Roberts RG, Oesterling JE, Wasson JH. Prostate cancer screening and beliefs about treatment efficacy: a national survey of primary care physicians and urologists. Am J Med. 1998;104:526–532. doi: 10.1016/S0002-9343(98)00124-7. [PubMed] [Cross Ref]
Sirovich BE, Schwartz LM, Woloshin S. Screening men for prostate and colorectal cancer in the United States: does practice reflect the evidence? JAMA. 2003;289:1414–1420. doi: 10.1001/jama.289.11.1414. [PubMed] [Cross Ref]
Voss JD, Schectman JM. Prostate cancer screening practices and beliefs. J Gen Intern Med. 2001;16:831–837. doi: 10.1046/j.1525-1497.2001.10133.x. [PMC free article] [PubMed] [Cross Ref]
Yarnall KS, Pollak KI, Ostbye T, Krause KM, Michener JL. Primary care: is there enough time for prevention? Am J Public Health. 2003;93:635–641. doi: 10.2105/AJPH.93.4.635. [PubMed] [Cross Ref]
Dunn AS, Shridharani KV, Lou W, Bernstein J, Horowitz CR. Physician-patient discussions of controversial cancer screening tests. Am J Prev Med. 2001;20:130–134. doi: 10.1016/S0749-3797(00)00288-9. [PubMed] [Cross Ref]
Carlsen B, Aakvik A. Patient involvement in clinical decision making: the effect of GP attitude on patient satisfaction. Health Expect. 2006;9:148–157. doi: 10.1111/j.1369-7625.2006.00385.x. [PubMed] [Cross Ref]
Frosch DL, Kaplan RM. Shared decision making in clinical medicine: past research and future directions. Am J Prev Med. 1999;17:285–294. doi: 10.1016/S0749-3797(99)00097-5. [PubMed] [Cross Ref]
Williams RM, Zincke NL, Turner RO, Davis JL, Davis KM, Schwartz MD. Prostate cancer screening and shared decision-making preferences among African-American members of the Prince Hall Masons. Psychooncology. 2008;17:1006–1013. doi: 10.1002/pon.1318. [PubMed] [Cross Ref]
Woolf SH, Krist AH, Johnson RE, Stenborg PS. Unwanted control: how patients in the primary care setting decide about screening for prostate cancer. Patient Educ Couns. 2005;56:116–124. doi: 10.1016/j.pec.2003.12.002. [PubMed] [Cross Ref]
National Center for Health Statistics, U.S.Department of Health and Human Services. Health, United States, 2007 with Chartbook on Trends in the Health of Americans. DHHS publication 2007-1232. Hyattsville, MD. http://www.cdc.gov/nchs/data/hus/hus07.pdf
Gann PH, Hennekens CH, Stampfer MJ. A prospective evaluation of plasma prostate- specific antigen for detection of prostatic cancer. JAMA. 1995;273(4):289–94. doi: 10.1001/jama.273.4.289. [PubMed] [Cross Ref]
Labrie F, Dupont A, Suburu R, Cusan L, Tremblay M, Gomez JL, Emond J. Serum prostate specific antigen as pre-screening test for prostate cancer. J Urol. 1992;147(3 Pt 2):846–51. [PubMed]
Mettlin C, Murphy GP, Babaian RJ, Chesley A, Kane RA, Littrup PJ, Mostofi FK, Ray PS, Shanberg AM, Toi A. The results of a five-year early prostate cancer detection intervention. Investigators of the American Cancer Society National Prostate Cancer Detection Project. Cancer. 1996;77(1):150–9. doi: 10.1002/(SICI)1097-0142(19960101)77:1<150::AID-CNCR25>3.0.CO;2-3. [PubMed] [Cross Ref]

Articles from BMC Medical Informatics and Decision Making are provided here courtesy of
BioMed Central