New challenges in endpoints for drug development in advanced melanoma

doi:10.1158/1078-0432.CCR-11-2323

Abstract

During the past three decades, the field of clinical research for the treatment of advanced melanoma lacked significant advances. Available drugs had low antitumor activity and no proven benefit in overall survival. Recently, new drugs developed based on an in-depth understanding of the biology of this disease have demonstrated significant benefit, with ipilimumab and vemurafenib having recently shown a positive impact in overall survival in patients with metastatic melanoma leading to approval in this indication by the US Food and Drug Administration (FDA). This rapid introduction of new active agents is likely to challenge current notions on how to develop future agents for the treatment of melanoma. The strong evidence of benefit for initial agents that modulate immune regulatory checkpoints or target driver oncogenes has spurred great interest in developing other similarly acting agents. However, this will pose problems in the choice of endpoints for the future definitive clinical trials, and the hurdles for achieving these endpoints will be higher given the similar activity for comparator agents or the availability of competing agents for salvage therapy. This new reality will likely require tailoring the registrational clinical trial endpoints to the patient benefits demonstrated in early clinical testing. In this report we illustrate the challenges in the choice of endpoints for registrational trials in metastatic melanoma and that, with an improved understanding of the agent being developed, the design of the registrational programs can be informed by earlier mechanistic studies to define the assumptions for definitive clinical testing.

The rapidly changing landscape of advanced stage melanoma treatment and its implications for new drug development

For over 30 years there has been a seemingly low hurdle for new agents to demonstrate efficacy in the treatment of unresectable stage III or IV melanoma (advanced melanoma). Yet during this time only three drugs were approved by the U.S. Food and Drug Administration (FDA) for this disease: dacarbazine, hydroxyurea and interleukin-2 (IL-2). Of these only dacarbazine was widely used in the community and considered a standard treatment. For patients with progression after one of these agents, no second line treatment whatsoever was agreed upon. Prospective trials involving dacarbazine had shown response rates in the 10% range, without a demonstrated improvement in overall survival compared to supportive care. Multiple investigational agents tested during this long period of time failed to demonstrate significant benefit over dacarbazine, contributing to the widely held belief that melanoma is resistant to standard chemotherapy agents (1). This included the extensive clinical testing of combinations of immunotherapy and chemotherapy agents (so called biochemotherapy regimens), where relatively high response rates were reported without an understanding of their mechanism of action, but overall survival was repeatedly not improved over other regimens (2, 3).

Recently, advances in the molecular understanding of how the immune system can be modulated to fight melanoma, and of the oncogenic driver mutations that underlie melanoma cells, are leading to dramatic changes in how the field regards standard treatment options for patients with advanced melanoma. As melanoma oncologists, we now need to change our paradigm of therapy for the first time, and consider disease biology in relation to new agents that have shown improvement in overall survival for patients with advanced-stage melanoma. First, two clinical trials evaluating the immune modulating antibody ipilimumab (previously MDX010) have demonstrated a statistically significant improvement in survival, one in previously-treated patients with metastatic melanoma compared to treatment with a peptide vaccine (4), and the other in first line therapy in combination with dacarbazine compared to single agent dacarbazine (5). These data led to the approval of ipilimumab by the FDA in March of 2011, the first new agent in 13 years for melanoma and the first ever based on a positive impact on overall survival. Soon thereafter, a randomized clinical trial demonstrated that the BRAF inhibitor vemurafenib (previously PLX4032/RG7204) improved both survival and interval to progression in first line therapy compared to dacarbazine (6) leading to the FDA approval in August of 2011. Vemurafenib had previously demonstrated unprecedented high response rates in phase I and II testing in patients with BRAF^V600 mutant metastatic melanoma (7, 8). Similarly high response rates have been observed in the phase I trial of another specific BRAF inhibitor, dabrafenib (previously GSK2118436) (9) (50–80% objective response rates in both cases). Given these changes in the standard of care therapies for metastatic melanoma with new agents with demonstrated effects on overall survival, it is likely that in the next several years it will be harder to successfully demonstrate an additional benefit in overall survival of new agents compared to the recently approved ones. Therefore, the field of melanoma drug development is faced again with the question of which, if any, surrogate endpoints could be considered sufficient to demonstrate antitumor efficacy and clinical benefit in future pivotal clinical trials.

Different therapeutic approaches, different benefit measures

The new agents demonstrating activity in metastatic melanoma fall into two broad categories: i) immunotherapy, and in particular immune checkpoint modulating antibodies, and ii) oncogene-targeted therapies. The lead compounds for each approach (ipilimumab and vemurafenib, respectively) are being followed by other agents with effects on the same or similar pathways, which are likely to provide similar patient benefits. The immune modulating antibodies (anti-CTLA4, anti-PD1, anti-PDL1, anti-CD40, anti-CD137, anti-OX40) all aim to stimulate long-lasting antitumor immune responses. The antitumor benefits are noted clinically in a variable fraction (arguably small) of the patient population. For example, with the anti-CTLA4 antibody ipilimumab, the objective tumor response rate is on the order of 10–15%, but the reduction in the likelihood of death compared to a vaccine or dacarbazine was 34% and 28% respectively, with the prospect of cure in some of these patients (4, 10). The long term benefit is noted by a consistent absolute increase of approximately 10% of patients alive in the ipilimumab-containing study arms compared to the control therapy in the two pivotal clinical trials at the end of the study follow up period (4, 10). This late plateau (or “tail”) in the survival curve is highly reminiscent of that seen with high dose IL-2 (11), representing long term responders who remain relapse-free for years (Figure 1). With ipilimumab having demonstrated overall survival benefit in two randomized phase III trials, the development of other agents in this category of immunotherapy agents may involve direct comparison with this agent, perhaps with a focus on decreasing side effects while retaining survival benefits (non-inferiority clinical trials). Alternatively, trials of new immunotherapy agents (or combinations of new agents with ipilimumab) may seek to demonstrate higher objective response rates while preserving or even extending the survival benefits, which will be a higher hurdle to overcome, or test concurrent or sequential therapy schemes that may improve on the tail of the survival curves obtained with ipilimumab alone.

Figure 1

Effects of immunotherapy and targeted therapy on melanoma survival curves

On the opposite side of the spectrum are the dramatic initial results achieved with targeted therapies that block signaling from oncogenic driver mutations in melanoma (inhibitors of c-kit and BRAF) or downstream effectors (MEK inhibitors). The antitumor effects of these agents are restricted to subsets of melanomas that are dependent on a particular mutated oncogene or activated pathway, with minimal to no activity observed using these agents against tumors that do not have that oncogene or pathway “addiction.” In properly selected patients, initial response rates are very high with oncogene-targeted inhibitors (7–9, 12), but in a matter of months, tumors frequently find a way to escape these drugs’ antitumor effects via a variety of molecular mechanisms of acquired resistance (13–15). The benefit of oncogene-targeted agents is noted in early improvements in the progression free and overall survival curves, since the majority of patients derive a rapid anti-tumor response (Figure 1). However, the limited duration of these responses is less likely to change the slope of the tail of the survival curve than is seen with immunotherapy, based on the available data. Mature survival data are not yet available from the BRAF targeted therapy phase III trials (6), and even once available their interpretation will likely be complicated by crossover of control arm patients to agents inhibiting the same oncogenic signaling. Therefore, it is possible that we will not have reliable overall survival curves compared to a control arm to evaluate the long term effects of BRAF-targeted inhibitors in melanoma.

Therapeutic benefit measured as improvement in overall survival

There is no doubt that a drug has shown objective evidence of benefit when the hazard ratio for overall survival is improved compared to a concurrent control group within an adequately designed and conducted randomized clinical trial. Survival improvement is generally agreed upon as the preeminent goal of therapeutic trials in advanced disease, such that a clinical trial that aims to improve survival frequently does not also evaluate quality of life or other patient-reported outcomes related to symptoms of the disease. While survival benefits measured as a clinically significant improvement in hazard ratio over the new standards like ipilimumab or vemurafenib would be an obvious goal, with a higher hurdle of antitumor activity in the control arm it would be harder to demonstrate.

The recent experience in clinical trials with melanoma oncogene-targeted inhibitors using overall survival as an endpoint raise specific issues to be considered in the conduct of future randomized studies with overall survival as the primary endpoint (16). The controversies over the vemurafenib phase 3 clinical trial (16–18) raise the point that clinical trial endpoints and design need to be tailored to the emerging early evidence with a new therapy, and that the process needs to be dynamic as the body of knowledge increases while definitive trials are being planned.

When several agents with similar mechanisms of action and antitumor effects are being independently developed in the same study population, then the consideration for unplanned cross-over to a competing agent is another major problem for clinical trials with overall survival as endpoint (19). In addition, the availability of expanded access (“compassionate use”) programs for one agent may hamper accrual to phase III trials of another similar agent, especially if they involve open label assignment at randomization.

Overall survival is not the only clinically meaningful endpoint for a new agent in metastatic melanoma. It is hard to think that physicians would decide to not prescribe BRAF inhibitors (or other agents with similar reproducible high and rapid response rates in molecularly defined subsets of patients) for appropriate patients with bulky and symptomatic disease even if they did not demonstrate a prolongation of overall survival in a large cohort of patients followed for a long period of time. Based on these considerations, it is clear that overall survival in phase III randomized clinical trials can no longer be considered the only relevant clinical endpoint for new drug development in advanced melanoma. It will continue to be the preferred endpoint if the new agent has a mechanism of action significantly different from the emerging new standards (CTLA-4 and BRAF inhibitors), as long as the new agent does not provide strongly suggestive evidence of paradigm shifting antitumor activity in early single arm clinical trials (16, 18).

Therapeutic benefit measured as objective response rate

Clinical benefit is always harder to demonstrate in single arm clinical trials. It stands to reason that clinical benefit is evident whenever a patient with a symptomatic cancer receives a treatment that leads to objective regression of the cancer according to RECIST and this tumor shrinkage improves the symptoms. However, many experts in the melanoma field maintain that response rate may under- or over-estimate the agent’s effects. For example, high initial response rates with highly toxic biochemotherapy have not translated into overall survival benefit (20), while low response rates with ipilimumab have translated into a benefit in overall survival (4). The paradigm-shifting early antitumor activity of BRAF inhibitors has led to the proposal that molecularly targeted agents may be approved immediately after a phase I trial with an expansion cohort after providing a mechanism-driven unprecedented antitumor activity (measured as response rate) in a defined population (18). For example, should acquired resistance to BRAF inhibition prove susceptible to combinations of targeted agents that block the escape mechanisms, and these combinations are highly active in the clinic and well tolerated, this may be considered sufficient evidence for definitive clinical trials.

Therapeutic benefit measured as improvement in progression free survival (PFS)

The large cooperative group clinical trial experience with very low activity agents that were tested against metastatic melanoma over three decades has provided benchmarks for the natural history of melanoma, in what has come to be known as the Korn meta-analysis (21). PFS and overall survival benchmarks for over 2,100 patients enrolled in 42 clinical trials were found to fall within boundaries that could be statistically defined. The authors proposed that expected time-to-event endpoints could be derived from this analysis, such that future single arm clinical trials could be designed to demonstrate an improvement compared to this historical dataset. An example would be designing a trial to determine if a new agent has a 6-month PFS benefit that is statistically significantly better than the benchmark of 6-month PFS in the Korn meta-analysis (21). Such a design could facilitate the development of new agents by more rapidly selecting promising agents for phase III pivotal trials. However, the Korn meta-analysis has limitations as a basis for selecting benchmarks for current trials. Further study is required to determine how generalizable the results will be to current populations of patients with advanced melanoma. Indeed, it can be argued that these patients enrolled in older cooperative group trials differed in material ways from patients entered into recently conducted clinical trials. Differences could arise from improvements in the sensitivity of current screening studies, as well as differences in the populations selected for, to give only three recent examples, LDH levels, specific HLA types or the presence of specific mutations in the tumor. Provided that these important caveats are kept in mind, an agent developed in a single arm, multicenter study that has a PFS well beyond what would be expected from the Korn data may provide the rationale for further development in definitive phase III trials. The more ambitious assertion that such a single arm phase II trial showing time-to-event outcomes far outside the Korn boundaries might itself be grounds for regulatory filing does not seem warranted at this time.

The use of PFS as the primary endpoint for randomized phase III clinical trials would overcome many of the problems of using overall survival as the primary endpoint. The ethical questions of withholding a potentially active agent for the rest of the patient’s life if randomized to the control arm could be ameliorated by the possibility of crossover upon progression without affecting the primary endpoint. But the final results may be viewed as less compelling compared to an overall survival endpoint. Furthermore, biases in the evaluation of tumor progression and issues relating to the timing of imaging studies in the trial arms could erode confidence that observed PFS benefits are clinically meaningful. In addition, it is likely that clinical trial sponsors would not be keen to conduct a large study based solely on PFS improvement without the ability to also test for an overall survival improvement. An agent advanced on the basis of PFS impact could be at a commercial disadvantage compared to agents with demonstrated overall survival benefit. Furthermore, regulatory agencies and reimbursement policies in many countries may not recognize a new agent on the basis of PFS improvement in the absence of evidence of a significant improvement in survival.

Clinical trial endpoints adapted to the clinical effects of the new therapeutic approaches

With all these considerations and caveats regarding clinical trial endpoints, it is obvious that no single solution will apply to the range of new agents being developed in melanoma. An alternative to the “one-size-fits-all” approach is to generate data in early phase clinical trials to provide information on what would be the most promising endpoints, and in which particular patient populations, to pursue the registrational program. This premise requires a careful understanding of the underlying biology of the new agent starting in the early clinical development studies, and the entry of sufficient numbers of patients to the late phase I/II clinical trials to allow solid assumptions for the design of the following pivotal trials. Mechanism of action studies can take advantage of highly interventional small clinical trials focused on the study of tumor biopsies. These early studies may also allow restricting of the new drug’s development plans to a molecularly- or clinically-defined subgroup of patients where the benefit can be better demonstrated and with a smaller sample size needed.

The knowledge of the general aspects of the anticipated clinical benefits of immunotherapy and targeted therapy agents developed to date in patients with advanced melanoma (Figure 1) provides clues about improved design for future pivotal trials of these agents. If a new immunotherapeutic agent demonstrates low response rates but these are sustained and mediated by similar intra-tumoral infiltration by lymphocytes as seen with anti-CTLA4 antibodies (22–24), then it would be prudent to focus on the remarkable phenomenon of durable tumor responses as the main endpoint for pivotal trials. Similarly, if a new agent has a high response rate in a subset of the population with metastatic melanoma that is based on a good understanding of the molecular events that lead to these responses, then an endpoint that captured tumor response with a clinically meaningful duration would be an acceptable pivotal clinical trial goal (18). However, this would require a careful assessment of the risk/benefit ratio of the new approach and would only be directly applicable to highly active driver oncogene inhibitors. Finally, combinations of targeted therapies and immunotherapies should have the goal of demonstrating that the high frequencies of responses with targeted therapies become highly durable with the addition of immunotherapies, very likely requiring placebo-controlled randomized clinical testing.

Conclusions

Agents that are making a major impact in the treatment of metastatic melanoma have been developed based upon an elegant understanding of the underlying immunobiology of this cancer and the mutations that drive its progression. It is a logical next step to adapt the clinical development plans of future agents to a deeper understanding of the mechanism of action by designing pivotal trials that focus on the strengths of the new agents and the potential benefits that may therefore be demonstrable in clinical trials. At long last, the bar has risen for the regulatory approval for drugs in melanoma, and the design of trials of new agents in clinical development will need to adapt to overcome these higher hurdles of activity. The best opportunity for positive outcomes will derive from early clinical testing that build the knowledge of the scope of the potential benefits of the new agent, leading to the registrational trials tailored to demonstrate that benefit.

Table 1

Relative merits of different endpoints in melanoma clinical trials

Statement of Translational Relevance

Development of new agents in patients with metastatic melanoma has new challenges after the recent evidence of positive impact on survival with ipilimumab and vemurafenib. We argue that adapting the drug development plans to the mechanism of action of the new agent or combination, and testing mechanism of action early in the clinical testing, will help in the design and conduct of definitive studies by informing on the choice of the most favorable primary study endpoints.

Acknowledgments

The authors would like to thank the members of the International Melanoma Working Group (IMWG) and Valerie Guild for fruitful discussions on the topics discussed in this manuscript. AR is funded by The Seaver Institute, the Caltech-UCLA Joint Center for Translational Research, the Wesley Coyle Fund, the Melanoma Research Alliance and the Melanoma Research Foundation. MRM is supported by the Oxford NIHR Biomedical Research Centre, Cancer Research UK and the UK Experimental Cancer Medicines Centre initiative. JMK is supported by the National Cancer Institute awards P50CA121973 and U10CA039229.

References

1. Tsao H, Atkins MB, Sober AJ. Management of cutaneous melanoma. N Engl J Med. 2004;351:998–1012. [PubMed]

2. Eigentler TK, Caroli UM, Radny P, Garbe C. Palliative therapy of disseminated malignant melanoma: a systematic review of 41 randomised clinical trials. Lancet Oncol. 2003;4:748–59. [PubMed]

3. Ives NJ, Stowe RL, Lorigan P, Wheatley K. Chemotherapy compared with biochemotherapy for the treatment of metastatic melanoma: a meta-analysis of 18 trials involving 2,621 patients. J Clin Oncol. 2007;25:5426–34. [PubMed]

4. Hodi FS, O’Day SJ, McDermott DF, Weber RW, Sosman JA, Haanen JB, et al. Improved Survival with Ipilimumab in Patients with Metastatic Melanoma. N Engl J Med. 2010 [PMC free article] [PubMed]

5. Tamoxifen in treatment of hepatocellular carcinoma: a randomised controlled trial. CLIP Group (Cancer of the Liver Italian Programme) [see comments] Lancet. 1998;352:17–20. [PubMed]

6. Chapman PB, Hauschild A, Robert C, Haanen JB, Ascierto P, Larkin J, et al. Improved survival with vemurafenib in melanoma with BRAF V600E mutation. The New England journal of medicine. 2011;364:2507–16. [PMC free article] [PubMed]

7. Flaherty KT, Puzanov I, Kim KB, Ribas A, McArthur GA, Sosman JA, et al. Inhibition of mutated, activated BRAF in metastatic melanoma. N Engl J Med. 2010;363:809–19. [PubMed]

8. Ribas A, Kim K, Schuchter L, Gonzalez R, Pavlick AC, Weber J, et al. BRIM-2: An Open-label, multicenter Phase II study of RG7204 (PLX4032) in previously treated patients with BRAF V600E mutation-positive metastatic melanoma. Journal of Clinical Oncology. 2011;29:Abstr 8509.

9. Kefford R, Arkenau H, Brown MP, Millward M, Infante JR, Long GV, et al. Phase I/II study of GSK2118436, a selective inhibitor of oncogenic mutant BRAF kinase, in patients with metastatic melanoma and other solid tumors. Journal of Clinical Oncology. 2010;28:611s.

10. Robert C, Thomas L, Bondarenko I, O’Day S, MDJ, Garbe C, et al. Ipilimumab plus dacarbazine for previously untreated metastatic melanoma. The New England journal of medicine. 2011;364:2517–26. [PubMed]

11. Atkins MB, Lotze MT, Dutcher JP, Fisher RI, Weiss G, Margolin K, et al. High-dose recombinant interleukin 2 therapy for patients with metastatic melanoma: analysis of 270 patients treated between 1985 and 1993. J Clin Oncol. 1999;17:2105–16. [PubMed]

12. Carvajal RD, Antonescu CR, Wolchok JD, Chapman PB, Roman RA, Teitcher J, et al. KIT as a therapeutic target in metastatic melanoma. JAMA: the journal of the American Medical Association. 2011;305:2327–34. [PubMed]

13. Nazarian R, Shi H, Wang Q, Kong X, Koya RC, Lee H, et al. Melanomas acquire resistance to B-RAF(V600E) inhibition by RTK or N-RAS upregulation. Nature. 2010;468:973–7. [PMC free article] [PubMed]

14. Johannessen CM, Boehm JS, Kim SY, Thomas SR, Wardwell L, Johnson LA, et al. COT drives resistance to RAF inhibition through MAP kinase pathway reactivation. Nature. 2010;468:968–72. [PMC free article] [PubMed]

15. Villanueva J, Vultur A, Lee JT, Somasundaram R, Fukunaga-Kalabis M, Cipolla AK, et al. Acquired resistance to BRAF inhibitors mediated by a RAF kinase switch in melanoma can be overcome by cotargeting MEK and IGF-1R/PI3K. Cancer Cell. 2010;18:683–95. [PMC free article] [PubMed]

16. Miller FG, Joffe S. Equipoise and the dilemma of randomized clinical trials. The New England journal of medicine. 2011;364:476–80. [PubMed]

17. Harmon A. When Testing a Drug Means Withholding It. New York Times. 2010 Sep 19;2010

18. Chabner BA. Early accelerated approval for highly targeted cancer drugs. The New England journal of medicine. 2011;364:1087–9. [PubMed]

19. Ribas A, Hauschild A, Kefford R, Punt CA, Haanen JB, Marmol M, et al. Phase III, Open-Label, Randomized, Comparative Study of Tremelimumab (CP-675,206) and Chemotherapy (Temozolomide or Dacarbazine) in Patients with Advanced Melanoma. Journal of Clinical Oncology. 2008;26:abstr LBA9011.

20. Atkins MB. Cytokine-based therapy and biochemotherapy for advanced melanoma. Clin Cancer Res. 2006;12:2353s–8s. [PubMed]

21. Korn EL, Liu PY, Lee SJ, Chapman JA, Niedzwiecki D, Suman VJ, et al. Meta-analysis of phase II cooperative group trials in metastatic stage IV melanoma to determine progression-free and overall survival benchmarks for future phase II trials. Journal of clinical oncology: official journal of the American Society of Clinical Oncology. 2008;26:527–34. [PubMed]

22. Hodi FS, Butler M, Oble DA, Seiden MV, Haluska FG, Kruse A, et al. Immunologic and clinical effects of antibody blockade of cytotoxic T lymphocyte-associated antigen 4 in previously vaccinated cancer patients. Proc Natl Acad Sci U S A. 2008;105:3005–10. [PubMed]

23. Ribas A, Comin-Anduix B, Economou JS, Donahue TR, de la Rocha P, Morris LF, et al. Intratumoral Immune Cell Infiltrates, FoxP3, and Indoleamine 2,3-Dioxygenase in Patients with Melanoma Undergoing CTLA4 Blockade. Clin Cancer Res. 2009;15:390–9. [PubMed]

24. Huang RR, Jalil J, Economou JS, Chmielowski B, Koya RC, Mok S, et al. CTLA4 Blockade Induces Frequent Tumor Infiltration by Activated Lymphocytes Regardless of Clinical Responses in Humans. Clin Cancer Res. 2011;17:4101–9. [PMC free article] [PubMed]