PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
J Natl Compr Canc Netw. Author manuscript; available in PMC 2012 December 21.
Published in final edited form as:
PMCID: PMC3528013
NIHMSID: NIHMS427419

Does Use of the Adjuvant! Model Influence Use of Adjuvant Therapy Through Better Risk Communication?

Abstract

Adjuvant! is a model that provides recurrence and mortality risk predictions for patients with breast cancer considering adjuvant therapies. Although low-risk patients who saw Adjuvant! chose adjuvant therapy less frequently, whether this was because of educational or other aspects of the decision aid is unknown. The authors explored whether Adjuvant! affects choice of therapy through increased patient knowledge. A subset of data were analyzed from a cluster randomized trial in which oncology practices in 2 major United States cities were randomly assigned to use either Adjuvant! or an informational pamphlet to educate patients. Of 405 patients, 48 were low-risk, with 28 assigned to the decision aid and 20 to the pamphlet. Among the low-risk patients, using frequency tables and Fisher exact tests, the authors explored whether Adjuvant! was associated with more accurate patient estimates of survival; whether accuracy was associated with treatment choice; and whether, after controlling for accuracy, any remaining association was seen between Adjuvant! and treatment choice. Adjuvant! was associated with more accurate estimates of baseline prognosis compared with the pamphlet (57% vs. 25%; P = .04). Patients who had more accurate estimates of baseline prognosis were less likely to choose adjuvant therapy (62% vs. 89%; P = .04). After controlling for accuracy, no statistically significant association was found between the use of Adjuvant! and adjuvant therapy (P = .59 and P = .11 for inaccurate and accurate patients, respectively). Adjuvant! seems to influence patient choice through educational rather than other means of persuasion. However, many patients held inaccurate risk perceptions after viewing Adjuvant!.

Keywords: Risk communication, shared decision-making, decision aids, Adjuvant!, breast cancer, patient education

Patients with breast cancer who are at relatively low risk for recurrence or mortality after local therapy (surgery with or without radiation) face a “grey zone” decision about whether to undergo adjuvant therapy.1 The choice of therapy involves balancing uncertain risks and side effects with uncertain benefits. Informed consent requires that patients understand potential risks and benefits.2 Accordingly, oncologists present information regarding risks and benefits of adjuvant therapy, including its effects on 10-year survival and recurrence rates.3

Adjuvant! is a tool that provides personalized 10-year recurrence and mortality risk predictions for patients with breast cancer considering adjuvant therapies.46 These estimates are based on patient and tumor characteristics under different therapy choices and have been validated against a large Canadian dataset.7 One study suggests that 44% of community oncologists and 78% of research oncologists use printouts from the Adjuvant! Web site (adjuvantonline2.com) to estimate risks of recurrence or mortality.8

Previous research has shown that for low-risk patients, exposure to Adjuvant! is associated with less adjuvant therapy use.9,10 These reports did not explore the mechanisms behind this association. Moreover, pilot studies of patients exposed to Adjuvant! Suggest that only a minority of patients retain the estimates from Adjuvant!.1115 Therefore, whether Adjuvant! influences treatment choice through educating patients or other mechanisms is unknown.

The authors hypothesize that exposure to Adjuvant! is associated with increased accuracy of patient estimates of prognosis, and that patients with accurate estimates make different choices about therapy from those with inaccurate estimates. To test these hypotheses, the authors analyzed a subset of data from a randomized controlled trial of the effects of Adjuvant!,9,10 focusing on low-risk patients because previous research showed that Adjuvant! affected therapy choice for these patients.9 They chose to define low risk as a greater than 85% 10-year survival rate as predicted by Adjuvant!, which at the time represented a grey area for treatment. At intervention, patients with a greater than 10% recurrence rate would have been candidates for routine adjuvant therapy.16,17 As the objective was to study risk communication and therapy choice, the authors believed that the threshold of a greater than 85% 10-year survival rate would include not only patients who would have been candidates for adjuvant therapy, but also those for whom forgoing adjuvant therapy would have been appropriate according to the guidelines at the time.

This study explored the following questions to assess the specific mechanism affecting treatment choice:

  • Was Adjuvant! associated with more accurate patient estimates of prognosis compared with educational pamphlets?
  • Was patient accuracy associated with use of adjuvant therapy?
  • After controlling for accuracy, was residual association seen between Adjuvant! and use of therapy?

Figure 1 shows the relationships studied.

Figure 1
The arrows depict possible relationships. The numbers identify each of the research questions about these relationships: 1) Was Adjuvant! associated with more accurate patient estimates of prognosis compared to educational pamphlets? 2) Was patient accuracy ...

Patients and Methods

Patient Population

Patients were eligible for the original study if they were diagnosed with stage I through III breast cancer, had completed local therapy (surgery with or without radiation), were eligible for adjuvant therapy (chemotherapy, hormone therapy, or both), and did not have a history of breast cancer. A total of 432 patients participated in the study, and 405 provided complete data. The patients agreed to a study examining how patients and physicians communicate about health care decisions before their first meeting with their medical oncologist. The study was approved and reviewed by the institutional review boards at Case Western Reserve University and the University of Texas at San Antonio. For details about the original study, readers are referred to the primary publication.9

Study Design and Procedures

Physician practices were stratified by setting (community or academic) and then randomized to use Adjuvant! or the pamphlet. Patients in the Adjuvant! group were shown quantitative mortality and recurrence risk graphics, and a standard presentation to explain the graphics. Patients in the pamphlet group saw a pamphlet that discussed the different types of adjuvant therapy but did not contain quantitative risk estimates. Patients were expected to generate a numeric estimate based on whatever information they had available to them. In the pamphlet group, they were not primed with quantitative risk estimates. Overall, 58 oncologists in 14 oncology practices in Cleveland, Ohio and San Antonio, Texas participated during the study period (1998–2001). These practices included 9 community and 5 academic hospitals.

Outcomes, Measures, and Instruments

The secondary analysis explored the association between 3 dichotomous variables: intervention (Adjuvant! or pamphlet); accuracy of patient estimates of survival (within 5% of the Adjuvant! estimate or not); and treatment chosen (adjuvant therapy or not). Specifically, as a measure of patient accuracy, the authors compared each patient’s estimate of 10-year survival after local therapy alone versus the corresponding Adjuvant! estimate. Local therapy survival refers to survival after surgery with or without radiation (i.e., with no adjuvant therapy). The authors focused on this measure because it represents the baseline prognosis that all patients should understand as a matter of informed consent, and is an antecedent to understanding the effects of adding any therapy. A ±5% threshold for accuracy was used because this measure was previously found to be clinically relevant and to have desirable statistical properties.11

To measure patient estimates of survival, a research assistant administered a postintervention survey after the patient had been presented with the Adjuvant! intervention or the pamphlet control condition and completed the consultative visit with the medical oncologist. To generate Adjuvant! estimates and classify eventual treatment, the research assistant conferred with attending oncologists to confirm chart indications about the tumor size, grade, hormone receptor status, number of positive lymph nodes, comorbidity level, and whether the patient underwent chemotherapy, hormone therapy, both, or neither.

Interventions

In both the Adjuvant! and pamphlet groups, a physician first met with the patient to gather information about their cancer history and to conduct a physical examination. The patient then met with a health educator, who reviewed either a printout from Adjuvant! or a pamphlet. The pamphlet was based on common pamphlets in use, describing general information on adjuvant therapy, and did not contain numeric information. In the pamphlet arm, the health educator read the pamphlet aloud to the patient. In the Adjuvant! arm, the health educator used a standard script to review the results from Adjuvant! with the patient. Finally, the patient continued the consultation with the oncologist, who made a treatment recommendation.

Analysis Plan

Attention was focused on low-risk patients for 2 reasons: they were shown to have been most affected by the intervention, and recommendations about using adjuvant therapy are less clear for this population. For example, the NCCN Clinical Practice Guidelines in Oncology (NCCN Guidelines) suggest that low-risk patients with positive estrogen receptor status arrive at a shared decision with their oncologists regarding use of hormone therapy.1 Low-risk patients with negative estrogen receptor (ER) status may reasonably forego adjuvant therapy. An Adjuvant! Estimate of 10-year survival greater than 85% was used to classify patients as low-risk.

To examine questions 1 and 2, the authors examined frequency tables and tested the corresponding null hypotheses using a Fisher’s exact test, setting a 2-sided P value of 5% as the significance level.

To analyze question 3, the authors controlled for accuracy of the patient’s estimate and then looked for any remaining influence of Adjuvant! on patient choice. This was done by first stratifying the sample on accuracy and then examining the relationship between exposure to Adjuvant! and use of therapy within the accurate and inaccurate group. Two frequency tables were constructed, one for each accuracy stratum, and the corresponding null hypotheses was tested using the same approach as described for questions 1 and 2. The rationale behind this analysis plan was to ascertain whether Adjuvant! had significant effects after controlling for accuracy. A significant effect in either or both accuracy strata would suggest that mechanisms other than education were involved, whereas a finding of no significance would indicate that the primary effect came through Adjuvant! being used as an educational tool.

Results

Patient Population

The low-risk group consisted of 48 patients with an Adjuvant!-predicted 10-year local therapy survival rate of greater than 85%. Twenty-eight of these patients had been randomized to the Adjuvant! arm and 20 to the pamphlet arm. Overall, 70% were postmenopausal and 80% were ER-positive. Patients had a broad range of education: 10% had not completed their high school education, 38% were high school graduates, 19% had some postsecondary education, and 33% had a bachelors or graduate degree. No significant differences were seen among demographic variables, including age, income, education, race, marital status, or number of children.

Study Question 1

Adjuvant! was associated with more accurate patient estimates of baseline prognosis compared with usual care. In the low-risk group, 57% of the patients exposed to Adjuvant! and 25% of patients exposed to the pamphlet estimated their 10-year local therapy survival rate within 5% of the Adjuvant! estimate (P = .04, Fisher exact test, 2-sided; see Table 1).

Table 1
Relationship Between Intervention and Accuracy of Patient Estimates of 10-Year Survival

Study Question 2

Increased patient accuracy among low-risk patients was associated with fewer choosing adjuvant therapy. Of 21 patients who were accurate, 8 chose to forego adjuvant therapy, compared with 3 of 27 patients whose prognostic estimates were inaccurate (P = .04, Fisher’s exact test, 2-sided; see Table 2).

Table 2
Relationship Between Accuracy of Patient Estimates of 10-Year Survival and Use of Adjuvant Therapy

Study Question 3

Finally, an analysis was conducted to control for prognostic accuracy by stratifying the low-risk patients into separate accurate and inaccurate subsets. Before stratifying, a statistically significant difference was seen in the use of adjuvant therapy between the Adjuvant! and pamphlet groups. After stratifying, no difference was found. Specifically, of the patients who were inaccurate, 2 of 12 in the Adjuvant! group chose no additional therapy, compared with 1 of 15 in the control group (P = .57). Of the patients who were accurate, 8 of 16 chose no additional therapy in the Adjuvant! group, compared with 0 of 5 who chose no additional therapy in the pamphlet group (P = .11, Fisher exact test, 2-sided; see Table 3).

Table 3
Relationship Between Use of Adjuvant! Model and Use of Adjuvant Therapy While Controlling for Accuracy of Patient Estimates of 10-year Survival

Discussion

The analyses conducted support the hypothesis that, among low-risk patients, Adjuvant! influences patient choice through increasing patient accuracy. Specifically, the authors found that Adjuvant! was associated with more accurate patient estimates of survival and that increased patient accuracy was associated with the decision to undergo adjuvant therapy. The authors also explored whether any residual association was seen after controlling for patient accuracy, but no statistically significant associations were seen. However, among accurate patients, the proportions were strikingly different: 8 of 16 (50%) chose to undergo additional therapy in the Adjuvant! group, compared with 5 of 5 (100%) in the pamphlet group. Although this was not statistically significant, this analysis should be replicated with a larger number of low-risk patients. Any significant residual association should stimulate researchers to search for other mechanisms through which the Adjuvant! presentation might be influencing the use of adjuvant therapy. If a larger study does not show a residual association, it would support the hypothesis that education is the primary mechanism through which Adjuvant! influences choice.

This study has other limitations. The choices of therapies today are more complex than they were when the study was conducted. The Adjuvant! predictions are known to be slightly inaccurate for certain population groups (< 35 y or with known additional adverse prognostic factors such as LVI).7 Furthermore, new genomic profiling tools, such as Oncotype DX, are available. This could make communication even more difficult today. Although the conclusions of this study were generated in the context of the Adjuvant! decision aid, they may be generalizable to risk communication for additional therapy choices and risk estimates based on more comprehensive patient information.

The results of this study are consistent with the overall literature on decision aids, showing that they do improve risk perceptions.18 However, although the improvements in risk perceptions are statistically significant, these could be greater. In the Adjuvant! group, 57% of patients estimated their baseline survival to within 5% of the Adjuvant! predictions. This falls within the 35% accuracy found in a pilot study of Adjuvant!11,13 and the 60% accuracy found in a study of a different decision aid for breast cancer.19

One feature of this study must be highlighted as both a strength and limitation. The authors conducted a secondary analysis on a subset drawn from a larger primary dataset. This made efficient use of resources. However, the primary study data were collected between 1999 and 2001, meaning that these findings may be outdated. The rationale for conducting this analysis despite the time lag is that the Adjuvant! printouts are identical to those used now, and there is no reason to believe that patient information processing mechanisms have changed.

The authors conclude that Adjuvant! helps many, but not all, low-risk patients improve their understanding of risks and benefits of adjuvant therapies for breast cancer (57% vs. 25% accurate). Low-risk patients who are well informed about their baseline survival prospects use less adjuvant therapy than patients whose perceptions of baseline survival are inaccurate (62% vs. 89% used adjuvant therapy). Although Adjuvant! seems to influence choice through patient education, researchers should replicate this result with larger numbers of low-risk patients.

Acknowledgments

This research was supported by a grant from the National Institutes of Health (National Cancer Institute; R01-CA71104), which supported collection of the data reported in this report (Dr. Siminoff); the National Institutes of Health (NIH) Office of Research on Women’s Health (ORWH) and National Institute of Child Health and Human Development (9K12HD052163-06, a career development award for Dr. Belkora); and a Stanford Graduate Fellowship (Dr. Hutton). The funding organizations had no role in the design and conduct of the study; collection, management, analysis, or interpretation of the data; or preparation, review, or approval of the manuscript.

The authors wish to thank the patients who participated in the study.

Footnotes

This paper was presented in part at the 2009 Society for Medical Decision Making annual meeting; October 18–21, 2009; Hollywood, California.

References

1. Carlson RW, Allred DC, Anderson BO, et al. NCCN Clinical Practice Guidelines in Oncology: Breast Cancer. [Accessed May 11, 2011];Version. 2011 2 Available at: http://www.nccn.org/professionals/physician_gls/f_guidelines.asp.
2. United States. President’s Commission for the Study of Ethical Problems in Medicine and Biomedical and Behavioral Research. Making health care decisions: the ethical and legal implications of informed consent in the patient-practitioner relationship. 1982 Retrieved November 7, 2006, from the President’s Council on Bioethics web site: http://www.bioethics.gov/reports/past_commissions/making_health_care_decisions.pdf.
3. Weinstein ND. What does it mean to understand a risk? Evaluating risk comprehension. J Natl Cancer Inst Monogr. 1999:15–20. [PubMed]
4. Ravdin PM. A computer program to assist in making breast cancer adjuvant therapy decisions. Semin Oncol. 1996;23:43–50. [PubMed]
5. Ravdin PM. A computer based program to assist in adjuvant therapy decisions for individual breast cancer patients. Bull Cancer. 1995;82(Suppl 5):561s–564s. [PubMed]
6. Ravdin PM, Siminoff LA, Davis GJ, et al. Computer program to assist in making decisions about adjuvant therapy for women with early breast cancer. J Clin Oncol. 2001;19:980–991. [PubMed]
7. Olivotto IA, Bajdik CD, Ravdin PM, et al. Population-based validation of the prognostic model ADJUVANT! for early breast cancer. J Clin Oncol. 2005;23:2716–2725. [PubMed]
8. Love N. Management of breast cancer in the adjuvant and metastatic settings. Patterns of Care in Medical Oncology. 2005;2:11–24.
9. Peele PB, Siminoff LA, Xu Y, et al. Decreased use of adjuvant breast cancer therapy in a randomized controlled trial of a decision aid with individualized risk information. Med Decis Making. 2005;25:301–307. [PubMed]
10. Siminoff LA, Gordon NH, Silverman P, et al. A decision aid to assist in adjuvant therapy choices for breast cancer. Psychooncology. 2006;15:1001–1013. [PubMed]
11. Belkora J, Moore DH, Hutton DW. Assessing risk communication in breast cancer: are continuous measures of patient knowledge better than categorical? Patient Educ Couns. 2009;76:106–112. [PMC free article] [PubMed]
12. Belkora J, Rugo HS, Moore DH, et al. Risk communication with patients with breast cancer: cautionary notes about printing Adjuvant! estimates. Lancet Oncol. 2008;9:602–603. [PubMed]
13. Belkora JK, Rugo HS, Moore DH, et al. Oncologist use of the Adjuvant! model for risk communication: a pilot study examining patient knowledge of 10-year prognosis. BMC Cancer. 2009;9:127. [PMC free article] [PubMed]
14. Hutton D, Belkora J, Shachter R, et al. Are patients getting the “gist” in risk communication: patient understanding of prognosis in breast cancer. J Cancer Educ. 2009;24:194–199. [PubMed]
15. Lipkus IM, Peters E, Kimmick G, et al. Breast cancer patients’ treatment expectations after exposure to the decision aid program Adjuvant Online: the influence of numeracy. Med Decis Making. 2010;30:464–473. [PMC free article] [PubMed]
16. Zujewski J, Liu ET. The 1998 St. Gallen’s Consensus Conference: an assessment. J Natl Cancer Inst. 1998;90:1587–1589. [PubMed]
17. Goldhirsch A, Glick JH, Gelber RD, et al. Meeting highlights: International Consensus Panel on the Treatment of Primary Breast Cancer. Seventh International Conference on Adjuvant Therapy of Primary Breast Cancer. J Clin Oncol. 2001;19:3817–3827. [PubMed]
18. O’Connor AM, Stacey D, Entwistle V, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2003 CD001431. [PubMed]
19. Whelan T, Sawka C, Levine M, et al. Helping patients make informed choices: a randomized trial of a decision aid for adjuvant chemotherapy in lymph node-negative breast cancer. J Natl Cancer Inst. 2003;95:581–587. [PubMed]