|Home | About | Journals | Submit | Contact Us | Français|
Evidence-based interventions have been found effective in increasing colorectal cancer (CRC) screening. Translating these successful interventions into real world settings, such as health plans, can be challenging.
CHOICE (Communicating Health Options through Information and Cancer Education) is a controlled trial to test the effectiveness of a patient and practice-level intervention to increase use of recommended CRC screening tests. The patient-level intervention was a patient decision aid and stage-targeted brochures, mailed to eligible health plan members, to provide information about CRC,available screening tests, and how to obtain CRC screening at their doctors’ practices. The practice-level intervention was academic detailing to prepare practices to facilitate CRC testing once the patient was activated by the decision aid. Surveys and claims data will be used to assess CRC screening test completion.
Thirty-two primary care practices in Florida and Georgia participated. We recruited 443 participating health plan members for the trial; 211 were patients in intervention practices; 232 were in usual care practices. Study participants reflected an insured population; the majority were white,and less than age 60. We also mailed the intervention to 343 people from intervention practices who did not respond to the eligibility baseline survey. Receipt of screening in that group will be compared to screening among 319 people from usual care practices who did not respond to these surveys using claims data.
The CHOICE study will demonstrate the effect of two combined evidence-based interventions on CRC screening test completion among health plan members.
Colorectal cancer (CRC) is the third most common cancer diagnosis and the third leading cause of cancer death among men and women living in the United States.1 In 2008, an estimated 148,810 people in the U.S. were diagnosed with CRC, and 49,960 died from the disease.2
Although use of CRC screening has increased since 2002, current screening rates remain modest, with only 60% of age-eligible U.S. adults up-to-date with screening in 2006.2, 3 Another analysis using NHIS survey data indicated that, on average, about 50% of U.S. adults obtained CRC screening within recommended time frames.4 Despite strong evidence and recommendations supporting its use, CRC screening is significantly underutilized.2, 3
Effective and efficient methods to promote colon cancer screening are needed to increase screening utilization in clinical practice and to decrease morbidity and mortality from colon cancer. Further, it is important to test whether interventions that are found efficacious in controlled trials can be translated to less controlled settings, such as health insurance plans.5-9 The CHOICE (Communicating Health Options through Information and Cancer Education) trial tests the effect of a combination of two evidence-based interventions, a decision aid for health plan members and academic detailing for physician practices, on CRC screening test completion by health plan members. This article describes the study design, interventions, and baseline findings.
CHOICE is a collaboration between two university research groups (at Emory University and the University of North Carolina) and Aetna's Southeast Region Quality Management Department.
This study received IRB approval from Emory University and the University of North Carolina. A partial HIPAA waiver was granted to allow access to information in Aetna's claims data repository for the purposes of identifying eligible health plan members. In addition, a full HIPAA waiver was obtained to send the decision aid intervention to non-responders who were potentially eligible in the intervention group and to permit access to follow-up claims data for non-responders in both the usual care and intervention groups.
To identify potential physician practices for participation, the study team obtained from Aetna a list of primary care physicians (family practice, general practice, and internal medicine) in the Atlanta, Tampa, and Orlando areas who participated in the Aetna HMO product. Medical practices recruited to the study had a minimum of 50 Aetna members between 52 and 75 years. Practices were recruited with a mailed introductory packet and telephone follow-up, supplemented with in-person visits, if requested by the practice.
As practices were enrolled into the study, they were grouped into three waves of 10 practices each. The first two waves were randomized into intervention and usual care groups. Randomization was done using matched pairs and a blocking procedure. Practices were matched on the number of study-eligible members per practice and rural vs. urban practices. These variables were chosen, because they may influence the effect of the intervention. When the third wave was recruited, intervention practice groups were unbalanced in practice size. Thus, purposive assignment to treatment group was used, resulting in a hybrid randomization procedure. Two additional practices were not randomized but included. These two practices initially were used as pilot practices (one intervention and one usual care). Because the intervention was not modified, and there were no differences in member characteristics for these two practices, the two practices also were included in the main trial.
Potentially eligible participants were identified using claims data from Aetna for members between the ages of 52 and 80 whose primary care physicians had agreed to participate in CHOICE. Members who were not current with CRC screening were eligible for the study. Potentially eligible members were identified by claims data in three waves across 2005 and 2006 as practices were recruited into the study. A final claims extract was obtained in March 2007 to identify newly-eligible members in participating practices and to determine whether any of the eligibility survey non-respondents were no longer eligible for the study due to new medical exclusions. Each extract included data for the current year and the three previous years, which is the time frame contained in the member claims database.
Members were considered up-to-date with screening, and therefore ineligible, if claims data indicated that they had received fecal occult blood testing (FOBT) within the last year or a sigmoidoscopy, colonoscopy or barium enema during the period covered by the claims data. Other exclusions included individuals at increased risk for CRC (because the intervention was designed for average-risk patients) or with medical conditions that would limit their ability to participate in the study or might cause them tobe considered inappropriate candidates for screening and those unable to communicate effectively in English. Above average-risk persons were defined as adults with a personal history of CRC or polyps, a known history of CRC or polyps in a first-degree relative, or a known history of inflammatory bowel disease.
Potentially eligible members identified by claims data were sent a letter and a brief eligibility survey. The eligibility survey was used to obtain information about receipt of CRC screening that might not be in the claims data and to identify people at increased risk for CRC for whom the decision aid would not be appropriate (e.g. persons with a first degree relative with a history of CRC). Members who responded to the eligibility survey and who were eligible were sent a baseline survey . Those who responded to the baseline survey were enrolled.
The primary method of survey administration for health plan members was by mail. However, after two mailings (approximately one month apart), survey non-responders were given the opportunity to complete the surveys by telephone with trained research staff. An internet survey was available for those who preferred to respond online.
The intervention consisted of a combination of two evidence-based interventions, one targeted at the practice level (academic detailing) and the other at the patient level (decision aid). These two components of the intervention draw upon constructs from Social Cognitive Theory and The Transtheoretical Model or Stages of Change Model.10-12 Academic detailing sessions targeted constructs of collective self-efficacy and strategies of goal-setting and behavioral monitoring.10, 11 The decision aid intervention was based on constructs from the Transtheoretical Model (TTM)12 focusing on the pre-contemplation (not considering being screened), contemplation (considering being screened), and preparation (getting ready to be screened) stages.
The academic detailing intervention was modeled after previously successful detailing interventions to improve cancer screening in primary care practices.6-9 The goal of detailing was to prepare practices to facilitate CRC testing once patients were activated by the decision aid. Our previous work suggests that practice-level barriers are important barriers to test completion.13
Detailing sessions were led by two of the investigators from UNC (MP, CL) and two general internists at Emory. Academic detailers participated in a three-hour training session where materials and processes for the detailing were reviewed.
Physician academic detailers visited each intervention practice twice during the study, once soon after randomization and again after most patients from the practice had received their decision aids. At the first meeting, the two physician detailers and a research assistant met with participating physicians and support staff. The lead detailing physician gave a fifteen minute presentation to review the burden of colon cancer, current recommendations and screening tests, barriers to colon cancer screening, and previous interventions shown to increase screening test completion in primary care practices. Practice-specific claims-based screening rates were presented to the groups to provide a baseline measure of screening completion. The detailing physicians showed clips from the decision aid.
Detailing physicians then led a discussion about the practice's colon screening strategies, including preferred and available testing options, current office systems to facilitate screening such as reminders, electronic medical records, and whether the office performs in-office flex-sig or FOBT. Referral practices for colonoscopy procedures also were reviewed. Practices were asked to explicitly map current processes for colon cancer screening, including procedures for receiving patient phone calls and scheduling referrals.
During these meetings, detailers led discussions about plans to modify office practices to better accommodate patient requests for specific tests. Physicians and staff from the practice helped to develop a plan in consultation with the physician detailers. Detailers recorded information from the discussion and helped clarify the plan. These written plans were sent to the practices after the meeting for confirmation.
The second session was held after most patient interventions were mailed. The same detailing team returned to practices whenever possible. Detailers reviewed plans with the practices and addressed questions or concerns including any procedural barriers the practices had faced. For two practices, these sessions were conducted over the phone.
To standardize the academic detailing process and assure quality control, standardized notes were taken during detailing sessions, and detailers held a debriefing after each session.
The decision aid used in the CHOICE trial is a modified version of a previously tested decision aid, which had been found to be effective at increasing CRC screening rates (Pignone 2000). We refined the content and layout of the decision aid to include web-based interactive delivery. Following these changes, usability testing was performed using cognitive interviewing techniques. The decision aid was produced in DVD and VHS videotape formats to maximize usability by participants.
The duration of the decision aid was about 22 minutes. It included: 1) information on colorectal cancer and screening and 2) information about the specific screening tests and comparative information between tests (e.g efficacy) In the final section of the decision aid, the patient is asked to choose stage-targeted information in the form of a color-coded brochure corresponding to their readiness to be screened.
Decision aids were sent to intervention group members in a package that contained a tailored letter; decision aid with instructions for viewing; stage-targeted brochures; a co-payment and referral information sheet specific to Aetna members; CRC screening options chart; and a decision aid survey. The survey assessed the use of and reactions to the materials, and evaluated perceived changes in knowledge as a result of viewing the decision aid.
Participants in the intervention group who had not been screened as determined by self-report on the one year survey were sent a “booster” intervention. The booster consisted of a letter encouraging screening, information on how to learn more about CRC and CRC screening tests, and an action plan with steps to complete recommended screening tests.
Usual care practices received no academic detailing. All members affiliated with practices in both the intervention and usual care groups received Aetna annual reminders to obtain CRC screening.
To assess the effect of the intervention in a broader context, decision aid packages were sent to non-responding members in intervention practices. These were health plan members in participating practices who did not respond to either the eligibility survey or the baseline survey but had not refused participation in the study (Figure 1). These members will be included in the intention to treat analyses for CRC screening test completion based on analysis of claims data.
Intervention and usual care practices completed brief surveys to assess their CRC screening practices, referrals, and quality improvement initiatives prior to the intervention and again at the end of the study.
We measured completion of CRC screening for health plan members through Aetna claims data and participants self-report. Claims data were assessed for CRC screening test completion for members in both the intervention and usual care groups who had completed the eligibility and baseline surveys, as well as those who did not complete the eligibility and/or baseline surveys but did not refuse participation (Figure 1). We measured CRC screening test completion by participant self-report through the baseline survey and follow-up surveys. Follow-up surveys were sent at 12 months, and at 18 months for those who were unscreened at one year. Interest in CRC screening, intent to ask providers about screening, and readiness to be screened also were assessed on the baseline and follow-up surveys.
We measured social cognitive constructs in baseline and follow-up surveys as potential mediating variables. We performed factor analyses on survey items measuring attitudes, beliefs14, and perceptions about colorectal cancer and cancer risk15 in order to group the individual items into discrete dimensions. Factor analyses revealed four clearly delineated composite variables: 1) Perceived Risk of colon cancer (4 items: e.g., what is your chance of getting colon cancer in your lifetime; response was 5 point scale from very low to very high); 2) General Beliefs about colon cancer (4 items: e.g., a person with colon cancer would always have symptoms; response options were 5 point Likert scale from strongly agree to strongly disagree); 3) Fears about colorectal cancer screening (4 items: e.g., I am afraid of having an abnormal screening test result for colon cancer; response options were 5 point Likert scale from strongly agree to strongly disagree); and 4) Intrusive Thoughts about colon cancer (3 items: e.g., during the past month, how often have you thought about your chances of getting colon cancer; response options on 4 point scale of not at all to almost all of the time).
Other social cognitive items measured participants’ knowledge of the age at which CRC screening should begin; perceptions about whether participants had enough information on CRC screening in general, as well as whether they had enough information about specific screening tests, intentions to talk to their doctor about CRC screening (two items), willingness to pay for screening tests16, and desire to participate in medical decisions.17
Approximately one year from receipt of baseline surveys, we mailed participants 12-month surveys. Participants who reported that they were not screened at 12 months were sent the 18-Month Survey. Outcome measures and social cognitive construct measures were identical to the baseline survey.
Our power calculations were based on our expectation that the proportion screened in the intervention group would be 15 percentage points higher than the proportion screened in the usual care group (.40 Intervention Group and .25 Usual Care). This estimate was based on the efficacy trial of the CRC decision aid5 and related research on academic detailing.7, 9 To account for the design, a cluster randomized trial, we assumed a conservative estimate of the intraclass correlation, 0.0225 or less. Based on alpha=.05, a two-tailed test, and power set at 0.80, 10 practices in each arm would have sufficient power to detect a 15 percentage point difference in the proportion screened if at least 25 participants from each practice, or 500 total participants, were enrolled. To ensure a sample of this size, allowing for some practice drop-out and member non-participation, we aimed to recruit at least 30 practices (15 in each group), with each practice having a minimum of 50 Aetna members between the ages of 52 and 75 years.
We will employ an intent-to-treat approach for analyses, using outcome data on recent CRC screening. We will perform two separate analyses. First, we will analyze claims data for all health plan members who were determined to be eligible at the start of the study, and who did not opt-out (and thus received the intervention if their practice was randomized to that treatment group), even if they did not complete survey questionnaires. These analyses will include both active participants and non-respondents in practices participating in the CHOICE trial. Second, we will analyze CRC screening test completion for those who actively enrolled in the trial and completed surveys.
For baseline results in this paper, we report practice and member participation rates. We also report descriptive statistics from members’ eligibility and baseline surveys and the participating practice surveys. We compared demographic characteristics of those who responded to the eligibility survey to those who did not respond or refused, using chi-square tests. We also compared demographic and social cognitive characteristics for intervention and usual care groups using chi-square tests.
Two hundred forty-two practices in two states (170 in Florida, 72 in Georgia) were approached to participate to obtain our target of 32 practices (15% participation rate). The main reasons given for non-participation in the trial were that the practices were too busy and that they did not want more paperwork. Comparing characteristics of the practices in the intervention and usual care groups revealed equal numbers of practices with electronic medical records (n=6). More practices in the usual care group reported having a CRC reminder system in place than in the intervention group (7 vs. 4) (Table 1).
During the academic detailing sessions at intervention practices, a variety of office staff attended the sessions, including physicians, nurses, referral coordinators, and schedulers. For physicians, 33 of the 53 (62%) physicians in the intervention group attended the first academic detailing session. For the first sessions, an average of four other staff members attended. For the second detailing sessions, 20 physicians attended and, on average, one other staff member participated. Two of the sessions were conducted by phone because of scheduling difficulties.
From claims data, we obtained information for 5759 Aetna HMO members (Figure 1). We excluded 1739 people due to high risk factors for CRC or other ineligibility criteria. The most common exclusions, based on claims data, included 1119 people who had previously been treated for cancer, and 495 who had a history of coronary artery disease. Of the remaining 4020 members, 27% (n=1066) were found to be up-to-date with CRC screening.
We sent eligibility surveys to the remaining 2954 potentially eligible members to identify those who were ineligible for reasons not captured by the claims data. Among these, 1593 members (61%) returned eligibility surveys, 467 (61%) completed baseline surveys, and, 443 (211 in the intervention group and 232 in the control group) were included in analyses of baseline data.
A total of 662 members did not respond to eligibility surveys (n=524) or baseline surveys (n=138). Among these non-respondents, 343 were patients of intervention practices, of whom 297 were sent intervention materials; 319 were patients in usual care practices.
Using information from eligibility surveys, we compared characteristics of those who completed baseline surveys with those who did not respond to baseline surveys or withdrew from further participation (Table 2). The major difference between those who responded and those who did not or refused was race; whites were more likely to participate than Blacks and those of other races (p<0.0001).
Among 443 participants, most were women, white, and less than age 60 (Table 3). The majority had at least some college education, about a third had an income between $50,000 and $100,000. About half reported no chronic illnesses and about half visited the doctor 3 or more times over the last year.
There were some differences at baseline between the intervention and usual care groups, which we expected because we did not allocate at the patient level. Specifically, there were more white patients in the usual care group and more patients in Florida participating in the usual care group. A little less than half in both groups reported ever having received CRC screening on the eligibility survey. When asked again on the baseline survey, 10% in both groups reported screening within the past 3 months since the completing the baseline survey. Among those who did not report recent screening, 60% in the intervention and 56% in the usual care group (P=0.35) reported an intention to undergo screening in the next 6 months
At baseline, about 75% of participants perceived their CRC risk to be medium to high; most did not report having intrusive thoughts about getting colon cancer (Table 4). Less than half of patients expressed agreement with statements about colon cancer and CRC screening that would denote lower belief in the benefits of CRC screening. Less than half answered the knowledge question correctly. Most reported that they had already talked to their doctors about CRC screening. About 30% reported not having enough information about getting CRC screening and over 40% reported that they did not have enough information on types of screening tests. Approximately 40% expressed concerns about receiving CRC screening. Nearly 40% were willing to pay $200 or more out of their pocket to obtain CRC screening. Comparing the two groups in regard to social cognitive characteristics reveals some differences in general beliefs about colon cancer screening. Patients in the usual care group had a higher level of agreement with statements that indicate lower belief in the benefits of CRC screening, Other characteristics were similar.
In this paper, we present the methods and baseline findings from the CHOICE (Communicating Health Options through Information and Cancer Education) study. Some aspects of study design, recruitment process, and participants could affect results of the trial and warrant discussion.
First, for the practice intervention, we successfully recruited an adequate number of practices. However, recruitment was more difficult than anticipated. We approached 242 practices approached to enroll 32 practices. As a result, our participating practices may be a select group more interested in colorectal cancer screening than other primary care practices, and are willing to participate in a researh study. If our intervention proves to be successful, our results may not be generalizable to other less motivated practices.
Among practices participating in the study, the usual care and intervention practices appear similar for many of the characteristics we measured. An important difference, however, is that the usual care group has more practices with a CRC reminder system in place. If this difference has an effect, we expect it would bias the results toward the null, because usual care practices may have more effective CRC screening systems in place compared to intervention practices. Additionally, when considering the practice level intervention, not all physicians attended detailing sessions. This could potentially attenuate its effect.
For the member level intervention, our study design was to recruit from an insurance plan. Thus, our results may not be generalizable to the general U.S. population. Furthermore, those members who chose to participate may not reflect the population of insured patients in these two states, especially in regards to colorectal cancer screenings. Most participants believed that screening is beneficial, reported having talked to their doctor about screening and having enough information about the tests. Participants may be more responsive to the patient level intervention than those who did not participate.
We allocated practices based on practice size and surrounding population anticipating that these could have an effect on the intervention. As with any allocation method, there may be unmeasured differences between groups that could affect results. Because we allocated participating members at the practice level, we expected some baseline differences between participants in the intervention and usual care groups. We noted differences with regards to race and state. We will control for these baseline differences in outcomes analyses.
.Finally, our study design could activate both groups to have colon cancer screening. The participant recruitment and data collection process addressed colorectal cancer and could serve as a reminder. Then, it may be more difficult to demonstrate an effect of the intervention, because both groups are activated by the data collection process. To address this, we will compare results for participants in the trial to those who did not participate using claims data. Making this comparison will help us determine extent to which activation occurred
Despite these limitations, the CHOICE trial addresses an important issue, the under-utilization of colorectal cancer screening among a population with health insurance. CHOICE will determine whether two combined evidence-based interventions implemented in community settings increases colorectal cancer screening test completion among health plan members.
The authors wish to thank the following for their assistance with the study: Raquel Vazquez, Lauren Taglialatela, Jonathan Hawley, Vicki Whitlatch, Jennifer Griffith, DrPH, Alison Brenner, Murtaza Cassoobhoy, MD, and Lisa Bernstein MD
Grant support: This research was supported by grant number PH000018 from the Centers for Disease Control and Prevention.
Financial disclosures: The authors have no financial disclosures to report
Statement of informed consent: The study received IRB approval to use a combination of a partial HIPAA Waiver for access to claims data, written consent for full participants, and a full HIPAA waiver to access data for non-responders. (See text for details)