PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of biotechhealthLink to Publisher's site
 
Biotechnol Healthc. 2010 Summer; 7(2): 18–24.
PMCID: PMC2899798

The Value of Observational Cohort Studies for Cancer Drugs

Abstract

Randomized controlled trials — the gold standard for clinical drug evaluation —can’t always predict adverse events in real-world settings. For the new cancer therapies, observational cohort studies (OCSs) can help evaluate their effects in broader populations and provide valuable information for future clinical trials.

The gold standard for determining the efficacy and safety of a new cancer therapy is the randomized controlled trial (RCT) (Silverman 2009). Randomization helps balance groups so that differences in outcomes can be attributed to the therapy being tested. RCTs, however, are challenging to conduct because of limited patient and financial resources, time constraints, competing studies, and changing physician and patient interest. Further, when RCTs are completed and produce positive (or negative) results, their findings may be limited in real-world applicability — cancer patients may not always mirror the characteristics of the patient group treated on study because of specific enrollment criteria, study-related procedures, ethical dilemmas, and differences inherent in those patients who chose to participate in the clinical trial. Consequently, how a new drug is used in practice may not always reflect how that drug was used on study, potentially affecting its real-world efficacy and safety profiles. Indeed, a major drawback of RCTs is their inability to definitively evaluate the safety profile of new cancer therapies — the true incidence of drug-related toxicities may not be determined, and newly emergent or rare events may go unreported (Avorn 2007, Ray 2003).

Healthcare payers and providers and pharmaceutical manufacturers, who increasingly rely on the use of evidence-based data to evaluate the effectiveness of innovative therapies relative to current standard-of-care practices, are now looking at additional sources of clinical outcomes data. Such data may come from additional randomized and nonrandomized interventional trials or observational cohort studies (OCSs), any of which may be mandated by the U.S. Food and Drug Administration as a phase 4 post-approval commitment.

An external file that holds a picture, illustration, etc.
Object name is f1-BTH07_2p018.jpg

David R. Spigel, MD

Advances in the understanding of cancer biology have led to the development of multiple new classes of molecular-targeted therapies. Although these therapies have improved survival in select cancers, their long-term benefits and safety profile have not yet been completely defined. Further, the paradigm of combination drug therapy has resulted in an increase in the number of regimens using these agents. Formal and rigorous post-approval study is necessary, therefore, to better characterize these agents and regimens.

WHAT IS AN OCS?

An OCS is an analysis of a group of individuals who have specific features in common and who are followed over a defined period of time.

Prospective OCSs are designed to examine predefined primary outcomes (Landewé 2007). OCSs are often referred to as registries (Lubeck 2007), although that term is misleading. A registry is a collection of population-based data, including incident events; for example, the Surveillance Epidemiology and End Results (SEER) registry (Lubeck 2007). Generally, a registry does not have prospectively defined outcomes of interest or a finite duration of follow-up and sample size. Analyses of registry data are typically retrospective, whereas OCS data often are prospectively (and retrospectively) analyzed (Landewé 2007). Differences exist among prospective OCSs in terms of design and scope. They may compare the outcomes of two cohorts — a treated group and a matched control group. This design is less common among post-approval OCSs where efficacy has already been established in an RCT. Post-approval OCSs generally follow a single cohort, although patient subgroups may be analyzed separately. With respect to scope, many smaller OCSs exist that include patients from restricted populations at single institutions, providing valuable center-specific information. To represent a broad and diverse patient base and to detect rare adverse events, large community-based, multicenter OCSs are useful in the post-approval setting for new therapeutics.

The goal of an OCS is to amass and record key disease- and/or treatment-related data over time for a large heterogeneous patient population treated by a broad base of practitioners (Lubeck 2007). Under that umbrella, an OCS can address specific questions and provide a variety of information that makes these studies valuable and relevant to patients, healthcare providers, and payers alike such as clinical efficacy, safety, survival, health-related quality of life, patient-reported outcomes, resource utilization, cost, clinical practice patterns, and change over time and by geographic region. An OCS also can identify gaps in current clinical trial research and help foster future development of a prospective RCT (Lubeck 2007). Table 1 shows the primary sources of clinical information.

TABLE 1
Primary sources of clinical information

PROS AND CONS

OCSs have both advantages and disadvantages (Table 2). A major advantage is the ability to collect data that would otherwise be difficult to capture in an RCT, such as rare adverse events, which are often constrained by size and study duration, or might simply be undetectable in a select trial population (Avorn 2007, Ray 2003). For example, neither the randomized trials nor a meta-analysis of those trials revealed the increased risk of myocardial infarction, renal failure, and stroke associated with aprotinin (Trasylol), a pancreatic trypsin inhibitor designed to decrease bleeding during surgery. These rare events were first identified in an observational study that ultimately led to withdrawal of the drug from the market (Mangano 2006, Sedrakyan 2004). Further, patients with uncommon tumor types are not well represented in clinical trials. A large observational study of patterns of care in follicular lymphoma found that only 6 percent of patients were treated as part of a clinical trial (Friedberg 2009). Additionally, older patients and patients with a poor performance status or comorbidities are frequently underrepresented in RCTs (Gridelli 2004, Kemeny 2003, Lewis 2003, Muss 2009). OCSs help fill these knowledge gaps and provide additional disease and treatment management data.

TABLE 2
Advantages and disadvantages of observational cohort studies

Perhaps the most important advantage of OCSs is their utility in helping to characterize drug safety. Recently, there have been a number of post-marketing reports of excess toxicity leading to adverse outcomes for patients and, ultimately, the withdrawal of medications from the market, including tegaserod (Zelnorm), valdecoxib (Bextra), rofecoxib (Vioxx), cerivastatin (Baycol), troglitazone (Rezulin), and efalizumab (Raptiva) among others (Avorn 2006, FDA 2009, Genentech 2009, Topol 2004). As of March 2007, safety-based withdrawals represented approximately 3.5 percent of new molecular entities approved since 1971 (FDA 2009). The FDA assumes responsibility for the post-marketing safety of agents for companies that have not completed mandated Phase 4 trials, which has been an emerging problem in oncology where drugs are commonly ‘fast tracked’ for approval with a contingency for a follow-up phase 4 study. FDA resources to monitor agents, once approved, also are limited (Brower 2007, Greener 2005). The most recent data show that 70 percent of FDA-mandated post-marketing commitment trials are pending (no patient enrolled or animal dosed) or delayed (DHHS 2008). Furthermore, the FDA mandates very few large observational studies designed to assess safety, and, outside of manufacturer-initiated studies, relies largely on sporadic voluntary reports from patients and providers and independent case reports or small case reports for safety reporting (Avorn 2006, Greener 2005). Case reports are useful to detect events that are distinctive or have a close temporal relationship with medication use, but ultimately are limited by definition to one or at most a few patients, reflecting an almost anecdotal experience (Ray 2003).

The primary disadvantages of OCSs are potential biases inherent in the OCS design and any biases associated with pharmaceutical industry sponsorship. Patient selection (e.g., lack of randomization or unintentional inclusion or exclusion of particular patients); patient attrition (e.g., certain patients may be more likely to drop out); and treatment selection (e.g., a poor prognosis patient may be more likely to receive aggressive therapy than if on a clinical trial) are some biases. Accurately accounting for biases associated with attrition and treatment selection is both possible and important, whereas accounting for selection bias is not statistically feasible (Giordano 2008, Landewé 2007). Utilizing newer and more robust statistical methodologies may improve the results obtained from OCSs, and patient selection and data handling methods are currently evolving (Avorn 2007, Benson 2000, Landewé 2007).

Large OCSs, particularly those evaluating a specific drug, often are sponsored by the drug manufacturers, because of the high costs inherent in conducting these studies. With few exceptions, these studies are conducted voluntarily. However, pharmaceutical company sponsorship is a weakness of OCSs due to the possible introduction of further bias and concerns surrounding the lack of transparency (Avorn 2006, Hiatt 2006). The inherent concern is that the sponsor cannot be objective and will only report favorable outcomes while suppressing negative results (Hermann 2008). One approach to help mitigate this potential bias is to engage independent researchers on OCS steering committees and to make data available to participating investigators for additional analyses (Avorn 2007). Despite these drawbacks, an important consideration is that few OCSs would ever be conducted without a pharmaceutical sponsor. Ultimately, efforts to improve transparency in terms of the study protocol, conduct, and data analysis should be expected and encouraged by the sponsors of these studies.

OCSs AND CANCER DRUGS

The use of OCSs for evaluating drugs is not unique to oncology. An early example of an OCS was a study of antinausea drugs given in pregnancy that were examined for teratogenicity (Miklovich 1976). Recently, large studies have evaluated biologic agents.

One of the largest studies, the National Registry of Myocardial Infarction, evaluated over 2 million patients suffering acute myocardial infarctions, including over 900,000 patients eligible for reperfusion with either fibrinolytic agents (such as streptokinase, alteplase (Activase), reteplase (Retavase), or tenecteplase (TNKase) or primary percutaneous coronary intervention (Gibson 2008). The results of this study have been used to develop practice guidelines and evaluate the real-world applicability of those guidelines. Antitumor necrosis factor agents for rheumatoid arthritis (RA) have also been studied in large observational trials, a setting that mirrors the current situation in oncology (Gibofsky 2006, Zink 2005). With the approvals of biologics for RA, the need arose for long-term efficacy and safety data in a broad population receiving various nonbiologic concomitant therapies typically used in practice. This information was of particular interest, because these agents are chronic therapies, and in practice, patients received a number of different therapies in various sequences. Patients with RA receive different multidrug regimens with varying sequences according to clinical factors, varying prescribing patterns, and patient wishes. Capturing the efficacy and safety of a new agent in this milieu is not possible with an RCT but is necessary to fully characterize the potential benefits as well as harms.

Because patients are surviving longer with cancer, and targeted agents often have different tolerability profiles than the traditional cytotoxic agents, patients may take anti-cancer therapies chronically for several months or years rather than weeks or a few months. A critical need exists, therefore, for large, well-conducted OCSs for the post-approval evaluation of cancer drugs.

OCSs IN ONCOLOGY

A selection of ongoing OCSs in oncology is shown in Table 3. Most of the studies have included or plan to include large numbers of patients, providing robust datasets for analyses and can be categorized as one of two types: drug-specific outcomes (e.g., GIDEON, ARIES, and TRUST) or cancer-specific information and practices (e.g., reGIStry, National LymphoCare Study, and registHER). Several of these OCSs are evaluating therapies used to treat some of the most prevalent cancers, including non-small cell lung cancer (NSCLC), colorectal cancer (CRC), and breast cancers.

TABLE 3
Selected ongoing observational cohort studies in oncology

Drug-specific OCSs. One example of a large ongoing, multi-center drug-specific OCS is the Avastin (bevacizumab) Regimens: Investigation of Treatment Effects and Safety (ARIES) study. ARIES is enrolling patients who have received bevacizumab for either NSCLC or CRC at 248 sites in the United States —primarily community oncology clinics. Patients are eligible if they have metastatic or locally advanced CRC or NSCLC and were receiving bevacizumab for less than 3 months in combination with first-line chemotherapy for either indication or as second-line therapy for metastatic CRC. The planned sample size is 4,000 patients, with 2,000 patients for each tumor type. No assessments or treatments are specified by the protocol, and data are collected at baseline and then quarterly, including targeted safety events. The goal of this study is to further delineate the clinical outcomes associated with bevacizumab use in the practice setting. Bevacizumab, first approved in 2004 for the treatment of metastatic CRC, has been subsequently approved for metastatic breast cancer, advanced NSCLC, glioblastoma, and renal cell carcinoma. Other clinical investigational studies of multiple tumor types are underway, including phase 3 trials in ovarian and prostate cancers and lymphoma, among others.

Bevacizumab is the first and only antivascular endothelial growth factor monoclonal antibody approved as therapy, and complete characterization of the safety of this widely utilized therapy is warranted. Adverse events have been observed with bevacizumab in clinical trials, including severe hypertension, gastrointestinal perforations, arterial thromboembolic events, and proteinuria (Hurwitz 2004). OCSs, such as ARIES, have been developed to monitor the occurrence of these events in the general practice setting.

An analysis of 621 patients with NSCLC enrolled in ARIES indicated that the OCS included patients who would have been excluded from the pivotal phase 3 trial, specifically patients with poor performance status, brain metastases, and those receiving therapeutic anticoagulation (Lynch 2008, Sandler 2006). In the CRC patient cohort, ARIES will monitor the use of bevacizumab in patients who received the agent as both first- and second-line therapy (currently 82 [6.75 percent] of 1,214 reported patients) (Bekaii-Saab 2008). Similarly, ARIES will collect data on patients with poor performance status (ECOG PS >2) that were excluded from the phase III RCT in first-line CRC (Bekaii-Saab 2008, Hurwitz 2004).

Preliminary results from ARIES further indicate the utility of a large OCS for characterizing safety in a less selected population (Kozloff 2008, Lynch 2008). Among patients with NSCLC, each serious bevacizumab-related safety event occurred with an incidence of 1 percent or less in a patient population at higher risk for such adverse events due to the broader population studied (Lynch 2008). Similarly, low rates of serious events were observed in the CRC cohort (Bekaii-Saab 2008). Additionally, no new serious adverse events were reported in either cohort.

The Bevacizumab Regimens: Investigation of Treatment Effects and Safety (BriTE) OCS, investigating the use of first-line bevacizumab for metastatic CRC, has included patients 80 years and older, 161 (8.2 percent) of 1,953 patients (Kozloff 2008). This population is underrepresented in clinical trials, and preliminary results from BRiTE have indicated that these patients benefit from bevacizumab (Balducci 2007, Kozloff 2008). An ongoing representative cancer-specific OCS is the SISTER study, which will follow approximately 50,000 sisters of women who have had breast cancer and will prospectively examine environmental and familial risk factors for breast cancer and other diseases (NIH 2009).

OCSs also may focus on health-related quality of life associated with a specific type of cancer, such as the Memorial Sloan Kettering Cancer Center study of approximately 1,800 men with localized prostate cancer (NIH 2009). The National LymphoCare Study is collecting information on nearly 3,000 patients with follicular lymphoma, 80 percent of whom are treated at nonacademic sites, and is providing important insights into current treatment practices for this condition. Early analysis has revealed that physician practices differ from current guideline recommendations; specifically, among patients with Stage I/II disease, only about 30 percent of patients received initial treatment with radiotherapy and nearly 30 percent received no initial therapy (observation alone) despite the potential curability of follicular lymphoma at this stage. This study also will provide a valuable foundation on which to build future clinical trials (Friedberg 2009).

VALUE IN THE REAL WORLD

The development of targeted therapies represents a shift in the treatment paradigm for cancer. As survival continues to improve with advances in treatment, patients may receive long-term therapy; therefore, it is imperative to have a complete and thorough understanding of the safety and effectiveness of these drugs in the community practice. Clinical cancer studies are primarily designed to evaluate the efficacy of the agents within the confines of the trial construct, and it is not until post-approval use in larger numbers of patients that rare, but serious, drug-related events may emerge. Anecdotal case reporting of such events, while serving an important role in their recognition, is an insufficient method of determination. Prospective OCSs can provide valuable clinical information about the safety and effectiveness of cancer therapies and represent an additional source of clinical information that complements RCTs and other types of studies.

Footnotes

Disclosure

David R. Spigel, MD, reports no financial arrangements or affiliations that might consitute a conflict of interest with respect to the products mentioned in this article or their manufacturers.

Disclaimer: Support for third-party writing assistance for this article was provided by Genentech, Inc.

REFERENCES

  • Avorn J. Dangerous deception — hiding the evidence of adverse drug events. N Eng J Med. 2006;355:2169–2171. [PubMed]
  • Avorn J. In defense of pharmacoepidemiology — embracing the yin and yang of drug research. N Eng J Med. 2007;357:2219–2221. [PubMed]
  • Balducci L, Al-Halawani H, Charu V, et al. Elderly cancer patients receiving chemotherapy benefit from first-cycle pegfilgrastim. Oncologist. 2007;12:1416–1424. [PubMed]
  • Bekaii-Saab TS, Bendell JC, Cohn AL, et al. Initial results from ARIES, a multi-indication bevacizumab (BV) observational cohort study (OCS): characteristics of metastatic colorectal cancer (mCRC) patients (pts) receiving BV and chemotherapy (CT) in 2nd line J Clin Oncol 2008. 26Supplabstr 15002.
  • Benson K, Hartz AJ. A comparison of observational studies and randomized, controlled trials. N Engl J Med. 2000;342:1878–1886. [PubMed]
  • Blanke CD, Pisters PW, Trent JC, et al. Analysis of an observational registry of gastrointestinal stromal tumor (GIST) patients (pts) in the USA: reGISTry J Clin Oncol 2008. 26Supplabstr 21502.
  • Brower A. Phase 4 research grows despite lack of FDA oversight. Biotech Healthcare. 2007 Oct;16 [PMC free article] [PubMed]
  • DHHS (U. S. Department of Health and Human Services) Food and Drug Administration. Report on the performance of drug and biologics firms in conducting postmarketing commitment studies. Federal Register. 2008;3:2215709.
  • FDA (U.S. Food and Drug Administration) CDER 2007 update drug recalls and safety-based withdrawals. «http://www.fda.gov/cder/reports/rtn/2007/14_recalls.htm#safety». Accessed March 31, 2009.
  • Fischbach NA, Spigel D, Brahmer J, et al. Preliminary safety and effectiveness of bevacizumab (BV) based treatment in subpopulations of patients (pts) with non-small cell lung cancer (NSCLC) from the ARIES study: A bevacizumab (BV) treatment observational cohort study (OCS) J Clin Oncol 2009. 27Supplabstr 8040.
  • Friedberg JW, Taylor MD, Cerhan JR, et al. Follicular lymphoma in the United States: first report of the National LymphoCare Study. J Clin Oncol. 2009;27:1202–1208. [PMC free article] [PubMed]
  • Genentech announces voluntary withdrawal of Raptiva from the U.S. market [press release]. April 8, 2009. «http://www.gene.com/gene/news/press-releases/display.do?method=detail&id=12047». Accessed April 20, 2009.
  • Gibofsky A, Palmer WR, Goldman JA, et al. Real-world utilization of DMARDs and biologics in rheumatoid arthritis: the RADIUS (Rheumatoid Arthritis Disease-Modifying Anti-Rheumatic Drug Intervention and Utilization Study) study. Curr Med Res Opin. 2006;22:169–183. [PubMed]
  • Gibson CM, Pride YB, Frederick PD, et al. Trends in reperfusion strategies, door-to-needle and door-to-balloon times, and in-hospital mortality among patients with ST-segment elevation myocardial infarction enrolled in the National Registry of Myocardial Infarction from 1990 to 2006. Am Heart J. 2008;156:1035–1044. [PubMed]
  • Giordano SH, Kuo Y-F, Duan Z, et al. Limits of observational data in determining outcomes from cancer therapy. Cancer. 2008;112:2456–2466. [PubMed]
  • Greener M. Drug safety on trial. EMBO Reports. 2005;6:202–204. [PubMed]
  • Gridelli C, Ardizzoni A, Le Chevalier R, et al. Treatment of advanced non small-cell lung cancer patients with ECOG performance status 2: results of an European experts panel. Ann Oncol. 2004;15:419–426. [PubMed]
  • Groen H, Arrieta OG, Riska H, et al. The global TRUST study of erlotinib in advanced non-small-cell lung cancer (NSCLC) J Clin Oncol 2008. 26Supplabstr 19000.
  • Grothey A, Sugrue MM, Purdie DM, et al. Bevacizumab beyond first progression is associated with prolonged overall survival in metastatic colorectal cancer: results from a large observational cohort Study (BRiTE) J Clin Oncol. 2008;26:5326–5334. [PubMed]
  • Herrmann R. More on antiangiogenesis in colorectal cancer; Poster presentation. 44th Annual Meeting of the American Society of Clinical Oncology; May 31–June 2 2008; Chicago, IL.
  • Hiatt WR. Observational studies of drug safety — aprotinin and the absence of transparency. N Eng J Med. 2006;355:2171–2173. [PubMed]
  • Hurwitz HI, Fehrenbacher L, Novotny W, et al. bevacizumab plus irinotecan, fluorouracil, and leucovorin for metastatic colorectal cancer. N Engl J Med. 2004;350:2335–2342. [PubMed]
  • Kemeny MM, Peterson BL, Kornblith AB, et al. Barriers to clinical trial participation by older women with breast cancer. J Clin Oncol. 2003;21:2268–2275. [PubMed]
  • Kozloff MF, Sugrue MM, Purdie DM, et al. Safety and effectiveness of bevacizumab (BV) and chemotherapy (CT) in elderly patients (pts) with metastatic colorectal cancer (mCRC): results from the BRiTE observational cohort study J Clin Oncol 2008. 26Supplabstr 4026.
  • Landewé R, van der Heijde D. Primer: challenges in randomized and observational studies. Nat Clin Pract Rheumatol. 2007;3:661–666. [PubMed]
  • Lewis JH, Kilgore ML, Goldman DP, et al. Participation of patients 65 years of age or older in cancer clinical trials. J Clin Oncol. 2003;21:1383–1389. [PubMed]
  • Link BK, Taylor MD, Brooks JM, et al. Correlates of treatment intensity for initial management of follicular lymphoma (FL) in the United States: report from the National LymphoCare Study (NLCS). ASH Annual Meeting Abstracts Blood 2007. 110:abstr 2612.
  • Lubeck DP. Use of observational databases (registries) in research. In: Penson DF, Wei JT, editors. Clinical Research for Surgeons. Totowa, NJ: Humana Press; 2007. pp. 95–104.
  • Lynch TJ, Brahmer J, Fischbach N, et al. Preliminary treatment patterns and safety outcomes for non-small cell lung cancer (NSCLC) from ARIES, a bevacizumab treatment observational cohort study (OCS) J Clin Oncol 2008. 26Supplabstr 8077.
  • Mangano DT, Tudor IC, Dietzel C. The risk associated with aprotinin in cardiac surgery. N Engl J Med. 2006;354:353–365. [PubMed]
  • Miklovich L, van den Berg BJ. An evaluation of the teratogenicity of certain antinauseant drugs. Am J Obstet Gynecol. 1976;125:244–248. [PubMed]
  • Muss HB, Berry DA, Cirrincione CT, et al. Adjuvant chemotherapy in older women with early-stage breast cancer. N Eng J Med. 2009;360:2055–2065. [PMC free article] [PubMed]
  • NIH (National Institutes of Health) «http://www.clinicaltrials.gov». Accessed January 23, 2009.
  • Purdie DM, Berlin JD, Flynn PJ, et al. The safety of long-term bevacizumab use: results from the BRiTE observational cohort study (OCS) J Clin Oncol 2008. 26Suppl:abstr 4103.
  • Ray WA. Population-based studies of adverse drug effects. N Engl J Med. 2003;349:1592–1594. [PubMed]
  • Rugo H, Kaufman P, Tan-Chiu E, et al. Survival of patients with HER2+ metastatic breast cancer and use of trastuzumab following progression: analysis of RegistHER Presented at the 31st annual San Antonio Breast Cancer SymposiumDecember 10–14, 2008San Antonio, Texas abstr 3142.
  • Sandler A, Gray R, Perry MC, et al. Paclitaxel-carboplatin alone or with bevacizumab for non-small-cell lung cancer. N Engl J Med. 2006;355:2542–2550. [PubMed]
  • Sedrakyan A, Treasure T, Elefteriades JA, et al. Effect of aprotinin on clinical outcomes in coronary artery bypass graft surgery: a systemic review and meta-analysis of randomized clinical trials. J Thorac Cardiovasc Surg. 2004;128:442–448. [PubMed]
  • Silverman SL. From randomized controlled trials to observational studies. Am J Med. 2009;122:114–120. [PubMed]
  • Tanchiu E, Kaufman PA, Paik S, et al. registHER: a prospective, longitudinal cohort study of women with HER2 positive metastatic breast cancer J Clin Oncol 2005. 23Supplabstr 670.
  • Topol EJ. Failing the public health — rofecoxib, Merck, and the FDA. N Engl J Med. 2004;351:1707–1709. [PubMed]
  • Zink A, Listing J, Kary S, et al. Treatment continuation in patients receiving biological agents or conventional DMARD therapy. Ann Rheum Dis. 2005;64:1274–1279. [PMC free article] [PubMed]

Articles from Biotechnology Healthcare are provided here courtesy of MediMedia, USA