PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of nihpaAbout Author manuscriptsSubmit a manuscriptHHS Public Access; Author Manuscript; Accepted for publication in peer reviewed journal;
 
Med Care. Author manuscript; available in PMC 2013 August 1.
Published in final edited form as:
PMCID: PMC3389231
NIHMSID: NIHMS362457

Translating research into practice: the role of provider based research networks in the diffusion of an evidence-based colon cancer treatment innovation

Abstract

Background

Provider-based research networks (PBRNs) – collaborative research partnerships between academic centers and community-based practitioners – are a promising model for accelerating the translation of research into practice; however, empirical evidence of accelerated translation is limited. Oxaliplatin in adjuvant combination chemotherapy is an innovation with clinical trial-proven survival benefit compared to prior therapies. The goal of this study is to examine the diffusion of oxaliplatin into community practice, and whether affiliation with the National Cancer Institute’s (NCI’s) Community Clinical Oncology Program (CCOP) – a nationwide cancer-focused PBRN – is associated with accelerated innovation adoption.

Design, Setting, and Participants

This retrospective observational study used linked SEER-Medicare and NCI-CCOP data to examine Medicare participants with stage III colon cancer initiating treatment in 2003 through 2006, the years surrounding oxaliplatin’s FDA approval. A fixed-effects analysis examined chemotherapy use among patients treated outside academic centers at CCOP-affiliated practices compared to non-CCOP practices. Two-group modeling controlled for multiple levels of clustering, year of chemotherapy initiation, tumor characteristics, patient age, race, comorbidity, Medicaid dual-eligibility status, and education.

Results

Of 4,055 community patients, 35% received 5-FU, 20% received oxaliplatin, 7% received another chemotherapy, and 38% received no chemotherapy. 25% of CCOP patients received oxaliplatin, compared to 19% of non-CCOP patients. In multivariable analysis, CCOP exposure was associated with higher odds of receiving guideline-concordant treatment in general, and oxaliplatin specifically.

Conclusions

These findings contribute to a growing set of evidence linking PBRNs with a greater probability of receiving treatment innovations and high quality cancer care, with implications for clinical and research policy.

Keywords: colon cancer, translational research, diffusion of innovation, organization and administration, provider-based research networks

INTRODUCTION

For well over a decade, the Institute of Medicine (IOM) has focused intensively on improving health care quality through application of the best scientific knowledge. 13 Aspirations of crossing a quality chasm have motivated the development of strategies for linking research findings with treatment implementation, and developing strategies for dissemination and knowledge transfer.3,4 Despite this, many important new discoveries take years if not decades to enter routine practice.5,6 For example, a meaningful cancer innovation – tamoxifen for treatment of hormone receptor positive breast cancer – took 10 years to reach 70% utilization.7 Clearly, there is room for improvement.

The National Institutes of Health (NIH) embraced the IOM’s focus on quality through the NIH Roadmap.8 Recognizing that less than one percent of Americans seek healthcare through academic medical centers, the major hubs of clinical research,9 the Roadmap emphasizes practice-based research networks (PBRNs) and accelerating science while facilitating the translation of research into practice. 8 Facilitating research outside of academic centers, PBRNs are collaborative research partnerships between academic investigators and community-based practitioners, providing critical, stable infrastructure that supports community-based clinical research studies.8,10 Westfall and colleagues eloquently characterized PBRNs as “blue highways,” connecting the major academic centers to physicians and patients across the US.6 Through “blue highway” research, PBRNs accelerate science by improving access to research participation where the vast majority of the population seeks care – in the community. There, PBRNS serve as conduits for two-way information flow: community practitioners inform and improve clinical trials through communication of practical design and implementation considerations, while their research participation promotes a sense of familiarity, trust, and acceptance of research results, and strengthens their commitment to acting on findings. 4,11,12 Despite the urgent need to improve health care quality and the promise of PBRNs as a model for accelerating the translation of research into practice, compelling empirical evidence of such a link is exceptionally limited.1315

Colon Cancer, Oxaliplatin, and the NCI CCOP Program

In 2010, approximately 103,000 people in the United States were diagnosed with colon cancer (CC) and over 51,000 died from it; worldwide mortality rates generally exceed those in the US.16 Since 1990, consensus guidelines have called for post-surgical adjuvant chemotherapy as the standard of care for stage III CC.17 From 1990 to 2004, the combination of 5-fluoruracil (5FU) plus leucovorin (LV) was the standard of care based on substantial survival improvement compared to surgery alone.1719 In 2004, oxaliplatin was approved by the Food and Drug Administration (FDA) based on substantially better survival associated with its use in combination therapy with 5FU and LV, compared to 5FU and LV alone.20,21 Despite the survival benefit associated with oxaliplatin-containing therapy, community adoption of this innovation has been uneven.18

One of the two randomized controlled trials (RCTs) demonstrating the benefit of oxaliplatin was conducted through NCI CCOP practices.21 Briefly, CCOP is a cancer-focused PBRN connecting NCI Cooperative Groups (researchers at academic centers who develop clinical trials) with a nationwide network of community physicians treating cancer patients outside of academic medical centers and enrolling many of them on NCI clinical trials.22 CCOP is large, with nearly 3,500 community physicians and 390 hospitals in 34 states. Between 1999 and 2008, CCOP contributed 36% of all NCI trial enrollment.22 CCOP organizational goals specifically include enrolling patients on trials and accelerating the translation of evidence-based innovations into practice.22,23 As such, CCOP is an ideal research network for studying the role of PBRNs in facilitating the translation of research into practice.

This study responds to guidance from the IOM and the National Cancer Policy Board to assess patterns of care and factors associated with receipt of high quality care.2,3 Specifically, the objective of the study is to examine the association between PBRN research participation and innovation adoption, focusing on the case of oxaliplatin-containing adjuvant chemotherapy. It hypothesizes that provider affiliation with the National Cancer Institute’s (NCI’s) Community Clinical Oncology Program (CCOP) – a nationwide cancer-focused PBRN – is associated with accelerated diffusion of this innovation among community practices.

METHODS

Study Design and Population

This study employs a retrospective observational design with a two-group, multi-level primary analytic approach. Inclusion criteria reflect consensus guidelines regarding adjuvant therapy for Stage III CC.17,20,24 The study sample included individuals age 65 and older with stage III colon adenocarcinoma that was surgically resected within 180 days of diagnosis. Because CCOP engages community providers and not major academic medical centers, the study sample was restricted to those receiving primary surgery at a hospital that was unaffiliated or had a “Limited” affiliation with a medical school according to the Accrediting Council of Graduate Medical Education. Patients in Health Maintenance Organizations (HMOs) were excluded because HMO claims do not provide requisite procedure-level detail. To assure complete claims, participants included only those with continuous Part A and Part B enrollment from 12 months pre- through 12 months post-diagnosis. The study examined years 2003 through 2006, the years of the first international conference presentation of oxaliplatin’s efficacy in this population, through two years after FDA approval.

Data

The study sample is drawn from the NCI Surveillance Epidemiology and End Results (SEER)-Medicare program, linked to data on physician and hospital CCOP-affiliation data from the NCI CCOP Program. Briefly, SEER-Medicare is a collaboration between the NCI’s SEER Program of cancer registries and the Centers for Medicare and Medicaid Services (CMS).25 Cancer registry data are linked to administrative and claims data for individuals in the registries and also in Medicare. SEER data include demographic and incident cancer characteristics including stage and grade, among others, for approximately 25% of the US cancer population. Medicare provides health insurance for approximately 97% of Americans age 65 and over, and captures health services utilization and comorbid health conditions. Relevant to this study, approximately 64% of CC cases are diagnosed among those aged 65 and older, who experience approximately 73% of CC deaths.26

Main Outcome and Exposure

Receipt of adjuvant chemotherapy was the primary outcome of interest, measured as chemotherapy initiated within 120 days of surgery. Oxaliplatin-containing regimens were defined as those including oxaliplatin within 35 days of the first chemotherapy dose. Non-oxaliplatin containing regimen were defined and examined in two ways: first, as any form of 5-FU including capecitibine (and no oxaliplatin), and second, as any non-oxaliplatin chemotherapy.

Patients were designated as being “CCOP Patients” if they received cancer treatment from a CCOP-affiliated physician or hospital between diagnosis and first date of chemotherapy. Functional form was examined as continuous, proportion (semi-continuous), quadratic, cubit, binary (any vs. no CCOP exposure), and four-group categorical. To capture the degree of patient exposure to the CCOP, this measure was operationalized as the proportion of claims from CCOP-affiliated physicians or hospitals out of all claims (CCOP and non-CCOP, cancer and non-cancer) within the same surveillance window used to determine the primary outcome.

Covariates

Covariates were defined through previous research and a modified directed-acyclic graph (DAG), as-informed by theorized or actual association with care-seeking behaviors, treatment selection, or cancer outcomes.27,28 Person-level characteristics include age, race, gender, comorbidity, tumor grade, primary tumor site, Medicaid dual-eligibility status (i.e., the patient has limited financial resources and is eligible for Medicaid), census-level education, and year of first chemotherapy. Comorbidity was measured using the NCI Combined Comorbidity Index (CCI), and with individual constituent health conditions in the CCI.29 Hospitals were characterized by teaching status, designation as an NCI cancer center, and independent affiliation with NCI Cooperative Groups. Organizational affiliation with the American College of Surgeons Oncology Group (ACOSOG) was examined because the majority of ACOSOG sites are accredited by the ACOS Commission on Cancer (CoC) – a marker of program quality – and ACOSOG affiliation has been associated with accelerated innovation adoption.15,30

Analysis

Bivariate analysis examined crude associations among all variables to characterize measure relevance and independence, and included examination of variables’ functional form (e.g., continuous, categorical, etc.) to optimize the full use of information within the data while balancing statistical appropriateness and interpretability of results. Observations were examined independently and also clustered at the hospital level. Marginal mean models and generalized linear mixed models with maximum likelihood estimates were examined using Generalized Estimating Equations (implemented as the GENMOD and NLMIXED procedures, respectively in SAS 9.2). The marginal mean approach was selected to optimize model fit and interpretation of fixed effects. Modeling began by examining factors associated with the receipt of any adjuvant chemotherapy vs. no chemotherapy. Logistic models generated predicted probabilities to construct figures reflecting differential receipt of oxaliplatin-containing regimens across time. The main analytic model focused on factors associated with the receipt of oxaliplatin-containing regimens compared to 5-FU only regimens. Due to collinearity, dual-eligibility status was retained in lieu of census-level income measures. Fixed effects were examined as cooperative group affiliation, year of first chemotherapy, age, race, dual-eligibility status, and education. Effect modification was explored among measures of affiliation, race, and treatment as informed by our hypothesized causal model (DAG) and previous research.15,27,31 Final model selection was guided by theory and practical understanding of cancer care delivery, as well as statistical considerations such as effect estimate stability and statistical measures of model fit, while balancing interpretability and transparency.

RESULTS

As presented in Table 1, 5,732 individuals met study inclusion criteria, of whom 4,055 (71%) received surgery at a community hospital. Of these, 1,432 (35%) received 5FU, 821 (20%) received oxaliplatin, 264 (7%) received another or an unspecified chemotherapy, and 1,538 (38%) received no chemotherapy. Compared to other treatment groups, those receiving oxaliplatin were younger, more likely to have poorly differentiated disease, slightly healthier, wealthier and more educated. Those receiving no chemotherapy were the oldest (median age, 81.5), least healthy, and more likely than those receiving chemotherapy to be dually-eligible. Oxaliplatin use increased steadily during all study years (Table 2, Figure 1), and was more prevalent among those seeing CCOP providers, as was chemotherapy use overall.

Figure 1
Proportion of population receiving oxaliplatin-containing regimen, by year of treatment initiation and extent of CCOP interaction.
Table 1
Descriptive Characteristics of Overall Study Sample.
Table 2
Descriptive Characteristics of Study Sample, by CCOP Exposure.

As presented in Table 2, CCOP patients were more likely to include minorities, and were slightly younger than non-CCOP patients. Non-CCOP patients were more likely to have the primary tumor located in the sigmoid colon, have poorly differentiated disease, be dually-eligible for Medicaid coverage and live in lower education areas. Fewer CCOP patients had a recent history of cardiac or pulmonary disease, though otherwise were similar to non-CCOP patients in terms of comorbidities.

In univariate regression (Table 3a), the degree to which patients interfaced with CCOPs was strongly associated with the probability of chemotherapy receipt (OR 10.85, 96% CI: 7.25–16.25). For example, a 10% increase in the proportion of a patient’s health care claims from a CCOP provider was associated with a 27% increase in the probability of receiving adjuvant chemotherapy (calculated from OR in Table 3; 95% CI: 1.22 – 1.32). Among those receiving chemotherapy, 10% increase in CCOP exposure was associated with a 7% increase in the probability of receiving oxaliplatin (95% CI: 1.03 – 1.10). Diffusion of oxaliplatin into practice is reflected in Table 3b, where the probability of receiving oxaliplatin among those initiating chemotherapy in 2006 was 2.22 times greater than those doing so in 2004 (95% CI: 1.52–3.24).

Table 3
Univariate regression/Crude odds ratios in overall sample.

In multivariable analysis (Table 4), CCOP exposure was associated with oxaliplatin receipt: a 10% increase in the proportion of a patient’s claims from a CCOP provider is associated with a 6% increase in the probability of that patient receiving oxaliplatin (calculated from OR in Table 4). Those initiating chemotherapy in 2006 were 2.7 times more likely to receive oxaliplatin than those initiating chemotherapy in 2004. The probability of receiving oxaliplatin decreased as patient age increased. Those with a history of renal disease, acute cardiovascular history, or diabetes were less likely to receive oxaliplatin. Those living in the highest education areas had a greater probability of receiving oxaliplatin.

Table 4
Regression: Probability of receipt of innovative therapy (oxaliplatin-containing regimen) among those receiving any chemotherapy, 2003–2006.

Among sensitivity analyses, the binary measure of CCOP exposure was significant in all analyses, and model results were similar to those using the proportion of claims with a CCOP provider. Model fit was more stable and substantially stronger using the continuous measure (proportion of claims), reflecting the non-linear relationship between CCOP exposure and probability of oxaliplatin receipt demonstrated in univariate models of functional form and illustrated in Figure 1. To examine the prospective effect of ongoing clinical trial enrollment as it may differentially influence oxaliplatin use, models examined data restricted to years following FDA approval. Findings were nearly identical in effect size, though with substantially smaller sample size, confidence intervals for some measures were sometimes wider.

Discussion

To investigate whether PBRNs are associated with more rapid translation of research innovations into practice, this study examined the use of adjuvant chemotherapy for stage III CC among patients treated at NCI CCOP-affiliated practices compared to other community-based practices. Oxaliplatin-containing adjuvant therapy has yielded trial-proven improved survival compared to the prior standard therapy. 2022,24 Our results suggest that, compared to patients who received their care elsewhere in the community, patients who received their care from CCOP providers were more likely to receive this innovative therapy reflecting the best current scientific knowledge. Notably, a preponderance of the difference in CCOP versus non-CCOP oxaliplatin adoption appears to have occurred prior to FDA approval, likely due to clinical trial enrollment; however, this CCOP “advantage” remains persistent in all study years thereafter, including after FDA approval. These findings contribute to a growing set of evidence linking PBRNs to high quality cancer care.

In the short-term, these results demonstrate an association with improved quality of care for current cancer patients – receipt of trial-proven state-of-the-art therapy in lieu of inferior treatment options. At the same time, CCOP community-based practices also enroll approximately one-third of patients to NCI cancer treatment trials. 22 By doing so, CCOPs help accelerate enrollment and thus study completion times, and thus achieve the goals of the not only the Roadmap, but also more recent efforts such as the NCI Operational Efficiency Working Group, a goal of which is to identify strategies to “increase the percentage of studies that reach their accrual targets in a timely fashion.” 32 In turn, accelerated trial completion is anticipated to contribute to longer-term benefits, including a shortened time to the discovery of the next innovation and prospectively better outcomes for a larger number of future cancer patients.

The specific finding regarding the diffusion of oxaliplatin is important; however, the larger issue of adherence to consensus guidelines also merits discussion. Adjuvant therapy has been recommended for CC since 1990, and is an element of quality metrics defined by the American Society of Clinical Oncology Quality Oncology Practice Initiative (ASCO QOPI). 17,33 In our study population, a surprising 38% of patients did not receive any adjuvant chemotherapy. Many factors are likely contributory, including greater age, poorer health, and greater prevalence of specific contraindications among the untreated. For these patients, oxaliplatin’s potential survival benefit may not merit the risks of its associated additional toxicity, though they could appropriately receive 5-FU as a less toxic alternative.34 When controlling for such contraindications in this community-based study sample, patients receiving care from CCOP providers had substantially greater odds of receiving guideline concordant care vis-à-vis any adjuvant therapy (OR 12.97, 95% CI: 7.39 – 22.77 – Appendix Table 1), though the details of this care may have varied according to other measured and unmeasured factors in this population.

Appendix Table 1
Regression: Probability of receipt of adjuvant therapy among those with surgical resection, 2003–05.

Related to this, among limitations, the impact of several factors on treatment decisions is difficult to qualify using claims data. For example, a patient may have a comorbid condition, but the claims data do not characterize that condition’s severity or its immediate relevance. Moreover, the data do not measure some relevant factors, such as patient preference. By focusing primarily on patients who were healthy enough for surgery and received some form of chemotherapy, while excluding those who did not, this study took a conservative approach in order to minimize potential bias associated with treatment selection.

Characterizing the influence of a particular provider over treatment decisions is similarly challenging. We used the proportion of insurance claims from a CCOP provider as a proxy for the influence of the CCOP on treatment decisions. However, it is possible that a treatment plan could be defined by one physician who submitted a single insurance claim, though the plan was implemented in its entirety by another, who submitted all other claims. Sensitivity analyses using multiple forms of the CCOP exposure measure were consistent, strengthening our confidence in this study’s summary findings. Notably, a binary measure characterized patients as having any CCOP claims compared to those with no CCOP claims (Appendix 2). The effect estimate of CCOP exposure in this model was very similar in magnitude and direction as our primary model (Appendix 2: OR 1.38, 95% CI: 1.03–1.84; Table 4: OR 1.80, 95% CI: 1.14–2.85), suggesting that having any CCOP exposure may be influential in terms of treatment decisions, and increasing CCOP exposure may be associated with greater CCOP influence (Table 4). As it pertains to interpreting these models, we must point out that our study design and multiple sensitivity analyses led us to focus on models which produce odds ratios, which may be an overestimate of risk ratios under certain conditions.35 Future research may examine additional measures of health status, greater characterization of providers’ roles, and other factors in treatment decision-making than are allowed by these data.

Appendix Table 2
Regression: Probability of receipt of oxaliplatin-containing therapy among those initiating oxaliplatin-containing therapy or other 5-FU therapy in 2003–2006; CCOP exposure measured as binary measure (Any CCOP claims vs. No CCOP claims).

This study demonstrates an association between CCOP membership and accelerated innovation adoption, though it is not possible to definitively ascertain whether there is a direct causal relationship between the two. It is quite plausible that physicians who join the CCOP network are predisposed to follow the clinical research literature, engage with academic centers, and thus more rapidly learn of and adopt state-of-the-art innovations in their practice. It may be more simply that the pre-FDA approval, clinical trial era protocol-guided experience and familiarity with the innovation contribute a short-term advantage which, with momentum, remains persistent across time. The arguably greater rate of oxaliplatin adoption among non-CCOP providers following FDA approval suggests CCOP experience momentum is relevant; however, Figure 1 suggests the CCOP and non-CCOP patient population proportions are plateauing without converging, and thus other factors uniquely characterizing CCOP practitioners or their PBRNs are also relevant. Empirically proving causality is difficult in any study, and employing a study design that would allow a definitive causal determination is virtually impossible given the organizational setting, the tremendous size of the network, and the depth of intervention that is necessary. This being said, the CCOP Program is nearly 30 years old, as are several of the CCOP sites in this study. As such, this study suggests that once the local CCOP practices are funded, their infrastructure and systems can successfully support and perpetuate the prioritization of research and the corresponding translation of research into practice through multiple generations of physicians at these practices.

Study data did not include a patient-level measure of trial participation and were deidentified, precluding the ability to differentiate those enrolled in a trial from those not enrolled. Inability to identify trial participants may contribute bias to our interpretation of the association between CCOP and oxaliplatin use among non-trial participants. This being said, not all CCOPs activated oxaliplatin trials; trial participants represent a small minority of community practice patients, even in CCOPs; and through randomization, only half of participants would have been in the trials’ experimental arm (receiving oxaliplatin); suggesting this risk of bias is somewhat limited. Moreover, CCOP patients were more likely to receive oxaliplatin than were non-CCOP community patients in all years – even after trial closure and FDA approval –suggesting robustness of the study’s primary findings.

The apparent multi-focal benefit of PBRNs compels us to revisit our national policies regarding paying for cancer clinical trials. Several studies have shown only a nominal increase in costs associated with NCI trial participation, yet hospital and insurance plan executives have consistently protested the additional cost and inefficiency incurred with offering trials to their patients, which they are loathe to subsidize directly or indirectly through clinical operations.36,37 This study suggests that the two worlds of clinical research and clinical practice are tightly intertwined, and efforts to separate and manage them independently may in-fact be counterproductive to the goals of each. There have been myriad calls to improve reimbursement for clinical trials and establish federal and state policies to lower barriers to insurance coverage for trial participants.38,39 While such policies have had mixed evidence of effectiveness,40,41 “pay-for-performance” and other emerging plans are gaining momentum, with a central premise of reimbursement incentives for higher quality care.42,43 It may be that a pay-for-performance reimbursement premium for improved quality will underwrite clinical research inefficiencies, and in a circular fashion the concomitant greater quality will help justify that premium.

We cannot disregard the current economic environment and the additional challenges facing CMS as the baby boomer generation ages into Medicare; however, we may simultaneously have an unprecedented opportunity for positive change as the nation works to refine and implement historic health care reform, while the NCI retools its clinical research enterprise following recent evaluations by the IOM and the NCI Operational Efficiency Work Group,32,44 and the NCI CCOP program continues its long history of self-evaluation and continuous improvement.22

Acknowledgments

Funding/Support: This work was funded by NCI grant 5R01CA124402, and directly informed by work performed in support of NCI Contract HHSN261200800726P. The work was supported in part by the Integrated Cancer Information and Surveillance System (ICISS), UNC Lineberger Comprehensive Cancer Center, through the University Cancer Research Fund via the State of North Carolina. This study used the linked SEER-Medicare database. The interpretation and reporting of these data are the sole responsibility of the authors. The authors acknowledge the efforts of the Applied Research Program, NCI; the Office of Research, Development and Information, CMS; Information Management Services (IMS), Inc.; and the Surveillance, Epidemiology, and End Results (SEER) Program tumor registries in the creation of the SEER-Medicare database. The collection of the California cancer incidence data used in this study was supported by the California Department of Public Health as part of the statewide cancer reporting program mandated by California Health and Safety Code Section 103885; NCI contracts N01-PC-35136, N01-PC-35139, and N02-PC-15105; and the Centers for Disease Control and Prevention’s National Program of Cancer Registries, under agreement #U55/CCR921930-02. This work was conducted following IRB review and approval at the University of North Carolina (IRB 05-2761).

Role of the Sponsors: The NCI had no role in the design and conduct of the study, in the collection, management, analysis, and interpretation of the data, or in the preparation, review, or approval of the manuscript. ICISS members (Carpenter, Meyer, and Wu) were involved in the design and conduct of the study, collection, management, analysis and interpretation of the data, and preparation, review, and approval of the manuscript.

References

1. Chassin MR, Galvin RW. The urgent need to improve health care quality. Institute of Medicine National Roundtable on Health Care Quality. JAMA. 1998 Sep 16;280(11):1000–1005. [PubMed]
2. Institute of Medicine. Ensuring Quality Cancer Care. Washington, DC: National Academies Press; 1999.
3. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington DC: National Academies Press; 2001. [PubMed]
4. Institute of Medicine. Bridging the Gap Between Practice and Research. Washington DC: National Academies Press; 1998.
5. Balas E. Information technology and physician decision support. Program and abstracts of Accelerating Quality Improvement in Health Care: Strategies to Speed the Diffusion of Evidence-based Innovations, sponsored by National Committee for Quality Health Care; Washington DC. January 27–28, 2003.
6. Westfall JM, Mold J, Fagnan L. Practice-based research--“Blue Highways” on the NIH roadmap. JAMA. 2007 Jan 24;297(4):403–406. [PubMed]
7. Mariotto A, Feuer EJ, Harlan LC, Wun LM, Johnson KA, Abrams J. Trends in use of adjuvant multi-agent chemotherapy and tamoxifen for breast cancer in the United States: 1975–1999. J Natl Cancer Inst. 2002 Nov 6;94(21):1626–1634. [PubMed]
8. Zerhouni E. The NIH Roadmap. Science. 2003;302:63–72. [PubMed]
9. Green LA, Fryer GE, Jr, Yawn BP, Lanier D, Dovey SM. The ecology of medical care revisited. N Engl J Med. 2001 Jun 28;344(26):2021–2025. [PubMed]
10. Carpenter WR, Weiner BJ. Encyclopedia of Health Services Research. SAGE Publications; 2009. Provider-Based Research Networks (PBRNs)
11. Lanier D. Practice-based research networks: laboratories for improving colorectal cancer screening in primary care practice. Med Care. 2008 Sep;46(9 Suppl 1):S147–152. [PubMed]
12. Sales A, Smith J, Curran G, Kochevar L. Models, strategies, and tools. Theory in implementing evidence-based findings into health care practice. J Gen Intern Med. 2006 Feb;21( Suppl 2):S43–49. [PMC free article] [PubMed]
13. Warnecke RB, Johnson TP, Kaluzny AD, Ford LG. The community clinical oncology program: its effect on clinical practice. Jt Comm J Qual Improv. 1995 Jul;21(7):336–339. [PubMed]
14. Laliberte L, Fennell ML, Papandonatos G. The relationship of membership in research networks to compliance with treatment guidelines for early-stage breast cancer. Medical care. 2005 May;43(5):471–479. [PubMed]
15. Carpenter WR, Reeder-Hayes K, Bainbridge J, et al. The role of organizational affiliations and research networks in the diffusion of breast cancer treatment innovation. Med Care. 2011 Feb;49(2):172–179. [PMC free article] [PubMed]
16. American Cancer Society. [Accessed January 15, 2011];Cancer Facts and Figures. 2010 http://www.cancer.org/acs/groups/content/@epidemiologysurveilance/documents/document/acspc-026238.pdf.
17. NIH consensus conference. Adjuvant therapy for patients with colon and rectal cancer. Jama. 1990 Sep 19;264(11):1444–1450. [PubMed]
18. Sanoff HK, Carpenter WR, Martin CF, et al. Comparative Effectiveness of Oxaliplatin vs Non-Oxaliplatin-containing Adjuvant Chemotherapy for Stage III Colon Cancer. J Natl Cancer Inst. 2012 Jan 20; [PMC free article] [PubMed]
19. Gill S, Loprinzi CL, Sargent DJ, et al. Pooled analysis of fluorouracil-based adjuvant therapy for stage II and III colon cancer: who benefits and by how much? J Clin Oncol. 2004 May 15;22(10):1797–1806. [PubMed]
20. Andre T, Boni C, Mounedji-Boudiaf L, et al. Oxaliplatin, fluorouracil, and leucovorin as adjuvant treatment for colon cancer. N Engl J Med. 2004 Jun 3;350(23):2343–2351. [PubMed]
21. Kuebler JP, Wieand HS, O’Connell MJ, et al. Oxaliplatin combined with weekly bolus fluorouracil and leucovorin as surgical adjuvant chemotherapy for stage II and III colon cancer: results from NSABP C-07. J Clin Oncol. 2007 Jun 1;25(16):2198–2204. [PubMed]
22. Minasian LM, Carpenter WR, Weiner BJ, et al. Translating research into evidence-based practice: the National Cancer Institute Community Clinical Oncology Program. Cancer. 2010 Jun 22; [PMC free article] [PubMed]
23. National Cancer Institute. The NCI Strategic Plan for Leading the Nation To Eliminate the Suffering and Death Due to Cancer. Rockville, MD: National Cancer Institute; 2007. http://strategicplan.nci.nih.gov/pdf/nci_2007_strategic_plan.pdf.
24. Hewitt M, Simone J. Enhancing Data Systems to Improve the Quality of Care. Washington DC: National Academy Press; 2000.
25. Warren JL, Klabunde CN, Schrag D, Bach PB, Riley GF. Overview of the SEER-Medicare data: content, research applications, and generalizability to the United States elderly population. Med Care. 2002 Aug;40(8 Suppl):IV-3–18. [PubMed]
26. Altekruse S, Kosary C, Krapcho M, et al. SEER Cancer Statistics Review, 1975–2007. Bethesda, MD: National Cancer Institute; 2010.
27. Mack CD, Carpenter W, Meyer AM, Sanoff H, Sturmer T. Racial disparities in receipt and comparative effectiveness of oxaliplatin for stage III colon cancer in older adults. Cancer. 2011 Nov 9; [PMC free article] [PubMed]
28. Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999 Jan;10(1):37–48. [PubMed]
29. Klabunde CN, Legler JM, Warren JL, Baldwin LM, Schrag D. A refined comorbidity measurement algorithm for claims-based studies of breast, prostate, colorectal, and lung cancer patients. Ann Epidemiol. 2007 Aug;17(8):584–590. [PubMed]
30. American College of Surgeons Commission on Cancer. [Accessed June 1, 2010];Commission on Cancer: About the CoC. 2010 http://www.facs.org/cancer/coc/whatis.html.
31. Reeder-Hayes KE, Bainbridge J, Meyer AM, et al. Race and age disparities in receipt of sentinel lymph node biopsy for early-stage breast cancer. Breast Cancer Res Treat. 2011 Aug;128(3):863–871. [PMC free article] [PubMed]
32. National Cancer Institute. Report of the Operational Efficiency Working Group Clinical Trials of the and Translational Research Advisory Committee. Rockville, MD: NCI; 2010. [Accessed July 15, 2011]. http://ccct.cancer.gov/files/OEWG-Report.pdf.
33. American Society of Clinical Oncology. [Accessed August 28, 2011];QOPI: The Quality Oncology Practice Initiative. http://qopi.asco.org/
34. Sargent DJ, Goldberg RM, Jacobson SD, et al. A pooled analysis of adjuvant chemotherapy for resected colon cancer in elderly patients. The New England journal of medicine. 2001 Oct 11;345(15):1091–1097. [PubMed]
35. Rothman K, Greenland S, Lash T. Modern Epidemiology. Philadelphia: Lippencott Williams & Wilkens; 2008.
36. Goldman DP, Berry SH, McCabe MS, et al. Incremental treatment costs in national cancer institute-sponsored clinical trials. JAMA: the journal of the American Medical Association. 2003 Jun 11;289(22):2970–2977. [PubMed]
37. Ault A. Who should subsidize NCI clinical trials? Nat Med. 1998 Sep;4(9):992. [PubMed]
38. Emanuel EJ, Schnipper LE, Kamin DY, Levinson J, Lichter AS. The costs of conducting clinical research. Journal of clinical oncology: official journal of the American Society of Clinical Oncology. 2003 Nov 15;21(22):4145–4150. [PubMed]
39. McBride G. More states mandate coverage of clinical trial costs, but does it make a difference? Journal of the National Cancer Institute. 2003 Sep 3;95(17):1268–1269. [PubMed]
40. Gross CP, Wong N, Dubin JA, Mayne ST, Krumholz HM. Enrollment of older persons in cancer trials after the medicare reimbursement policy change. Arch Intern Med. 2005 Jul 11;165(13):1514–1520. [PubMed]
41. Martel CL, Li Y, Beckett L, et al. An evaluation of barriers to accrual in the era of legislation requiring insurance coverage of cancer clinical trial costs in California. Cancer J. 2004 Sep-Oct;10(5):294–300. [PubMed]
42. Berwick DM. Measuring physicians’ quality and performance: adrift on Lake Wobegon. JAMA. 2009 Dec 9;302(22):2485–2486. [PubMed]
43. Rosenthal MB. Beyond pay for performance--emerging models of provider-payment reform. N Engl J Med. 2008 Sep 18;359(12):1197–1200. [PubMed]
44. Institute of Medicine. A National Cancer Clinical Trials System for the 21st Century: Reinvigorating the NCI Cooperative Group Program. Washington DC: National Academies Press; 2010. [PMC free article] [PubMed]