Search tips
Search criteria 


Logo of bmjoBMJ OpenVisit this articleSubmit a manuscriptReceive email alertsContact usBMJ
BMJ Open. 2017; 7(6): e015414.
Published online 2017 June 17. doi:  10.1136/bmjopen-2016-015414
PMCID: PMC5734370

How do smoking cessation medicines compare with respect to their neuropsychiatric safety? A protocol for a systematic review, network meta-analysis and cost-effectiveness analysis



Cigarette smoking is one of the leading causes of early death in the UK and worldwide. Public health guidance recommends the use of varenicline, bupropion and nicotine replacement therapy (NRT) as smoking cessation aids in the UK. Additionally, the first electronic cigarette has been licensed for use as a smoking cessation medicine. However, there are ongoing concerns about the safety of these medicines. We present a protocol for a systematic review and network meta-analysis (NMA) to determine how these smoking cessation medicines compare to each other with respect to their neuropsychiatric safety in adult smokers. Secondary aims include updating the evidence regarding the effectiveness and cardiovascular safety of these medicines for use in a cost-effectiveness analysis.

Methods and analysis

We will include randomised controlled trials and observational studies with control groups comparing monotherapy with varenicline, bupropion, NRT or electronic cigarette and combination therapies to each other, placebo or usual care. The primary composite safety outcome will be serious adverse events, defined as events that resulted in death, were life threatening, required hospitalisation or resulted in significant disability or congenital/birth defect. The preferred effectiveness outcome will be sustained smoking cessation defined as abstinence for a minimum of 6 months as determined by biochemical validation. We will include trials identified by previous reviews and search relevant databases for newly published trials as well as contacting study authors to identify unpublished information. We will conduct fixed-effect and random-effect meta-analyses for each pairwise comparison of treatments and outcome; where these estimates differ, we will consider reasons for heterogeneity, quantified using the between-study variance (τ2). For each outcome, we will construct a NMA in a Bayesian framework which will be compared with the pair-wise results, allowing us to rank treatments. The effectiveness estimates from the NMA will be entered into a probabilistic economic model.

Ethics and dissemination

Ethics approval is not required for this evidence synthesis study as it involves analysis of secondary data from randomised controlled trials and observational studies. The review will make an important contribution to the knowledge base around the effectiveness, safety and cost-effectiveness of smoking cessation medicines. Results will be disseminated to the general public, healthcare practitioners and clinicians, academics, industry and policy makers.

PROSPERO registration number


Keywords: varenicline, bupropion, nicotine replacement therapy, electronic cigarettes, smoking cessation, network meta-analysis

Strengths and limitations of this study

  • This study will be the first comprehensive review of the neuropsychiatric safety of smoking cessation medicines in relation to each other and will include randomised controlled trials of any duration as well as observational studies with control groups. Including observational studies will allow us to identify sufficient data for the network meta-analysis and improve the precision of estimates of adverse events.
  • This study will include trials of combined therapies of smoking cessation medicines, not included in previous network meta-analyses, as the analysis of both safety and efficacy data on coprescribing could be of important to regulators.
  • This study will produce updated cost-effectiveness analyses to estimate which smoking cessation medicine is the most cost-effective in UK settings.
  • We will use the Cochrane tool for assessing the risk of bias and consider using the risk of bias in non-randomised studies of interventions tool to assess the risk of bias in randomised controlled trials and observational studies, respectively.
  • This study will be limited to products licensed for use as smoking cessation aids in the UK.


Cigarette smoking is one of the leading causes of early death in the UK and worldwide.1 2 Each year, more than 100 000 people will die in the UK from smoking related diseases.3 The National Institute for Health and Care Excellence (NICE) public health guidance (published in 2008) recommends the use of three medicines, varenicline, bupropion and nicotine replacement therapy (NRT), as aids to quitting smoking in the UK.4 Additionally, in the late 2015, the Medicines and Healthcare Products Regulatory Agency (MHRA) approved the use of British American Tobacco’s electronic cigarette ‘e-Voke’ as a smoking cessation medicine.5 Since the publication of the original NICE guidance, there have been ongoing concerns about the safety of the smoking cessation medicines, with particular respect to the neuropsychiatric safety of varenicline. Severe safety warnings (black triangle and black box warnings) regarding a potential increased risk of serious neuropsychiatric adverse events (depression, suicidal ideation and suicidal behaviour) in patients prescribed these medicines have previously been issued by regulatory agencies such as the MHRA in the UK and the Food and Drug Administration (FDA) in the USA.6 7 These safety warnings were based on spontaneous reports to the UK Yellow Card Scheme and the FDA Adverse Events Reporting Database. Previous research into the neuropsychiatric safety of these medicines has provided inconsistent findings, adding to the debate.8 In April 2016, the results of Evaluating Adverse Events in a Global Smoking Cessation Study (EAGLES) trial,9 a randomised controlled trial (RCT) that randomised 8144 smokers to receive varenicline, transdermal NRT patch, bupropion or placebo, were published. The trial’s findings provided strong evidence that both varenicline and bupropion do not cause an increase in neuropsychiatric adverse events relative to nicotine patch or placebo. Subsequently, the European Medicines Agency lifted the warning about possible suicidal risks from varenicline in April 2016,10 followed by the FDA’s decision to remove the black box warnings on varenicline’s labelling in December 2016. While the EAGLES trial may be the largest global clinical trial of smoking cessation medicines, its sample size is limited relative to much larger observational cohort studies.11 12 Therefore, synthesising these findings with those of other RCTs, as well as synthesising the results of observational studies, will offer a more comprehensive review of the neuropsychiatric safety of smoking cessation medicines. With the MHRA’s licensing of the first electronic cigarette as a smoking cessation medicine, and given the popularity of electronic cigarettes with an estimated 2.8 million adult users in Great Britain,13 it is important to review their effectiveness as a smoking cessation aid as well as their safety.

The health benefits of smoking cessation have been well documented. Varenicline has been shown to be the most clinically effective monotherapy for long-term smoking abstinence (>6 months).14 However, the number of prescription items of varenicline dispensed in England decreased by 25% from a peak of approximately one million prescriptions in 2011 to almost 742 000 prescriptions in 2013,15 possibly reflecting ongoing fears among prescribers and patients regarding varenicline’s neuropsychiatric safety. It is important for patients, prescribers and regulators to know how smoking cessation medicines compare with each other, with particular respect to their neuropsychiatric safety, to enable smokers wanting to quit and their healthcare professionals to make informed decisions about the risks and benefits of the different pharmacological treatments. To date, there has been no comprehensive analysis of the neuropsychiatric safety of the smoking cessation medicines; previous systematic reviews have focused on comparisons of varenicline with placebo.16–18 In addition, the cost-effectiveness of these medicines in UK settings has not been investigated using the most up-to-date evidence. These analyses are important to inform the overall risk–benefit evaluation of the different smoking cessation medicines.

The ongoing debate regarding the neuropsychiatric safety of drugs for smoking cessation among drug regulators, researchers, prescribers and patients may be due to the inconsistent research findings in this area.8 Whereas studies without control groups (such as those using adverse event reporting data and case studies)19–21 have reported increased risks of self-reported depression and suicidal or self-injurious behaviour in patients prescribed varenicline and bupropion, studies with control groups (such as observational cohort studies and experimental study designs, mainly RCTs and systematic reviews of RCTs) have reported the opposite, and found no evidence of an increased risk of these severe neuropsychiatric outcomes in patients prescribed these medicines.11 16–18 22–24 However, there are important limitations associated with each of these study designs. First, studies which use spontaneous adverse event reports are limited by several factors. These include the severity of the adverse event (severe adverse events are more likely to be reported than less serious events),25 the length of time that the drug has been available (adverse events with newer drugs are more likely to be reported than events occurring with older drugs for the same indication) and media publicity about a drug (media reports often lead to increased reporting of adverse events to the Yellow Card Scheme, known as stimulated reporting).26 27 Second, observational cohort studies are prone to the effects of confounding by indication, which raises concerns about the validity of their findings.28 Confounding by indication may occur if an observed association between smoking cessation medicines and serious psychiatric events such as suicide is explained if the patient case mix differs among those taking different smoking cessation medications.11 12 29 In two of the earlier cohort studies, varenicline and bupropion were found to be associated with a decreased risk of death from all causes compared with NRT11 22; this reported protective effect was most likely due to residual confounding in the studies.

Experimental studies are less likely to suffer from uncontrolled confounding; however, to date, systematic reviews and meta-analyses of RCTs have mainly focused on comparing the neuropsychiatric safety of varenicline monotherapy with placebo.16–18 30 Although this is an important research question, patients are unlikely to be prescribed placebo in real-life settings to help them quit smoking. Therefore, the neuropsychiatric safety of varenicline compared with other smoking cessation drugs is likely to be of greater relevance to patients, prescribers and regulators. To date, there have been no comprehensive reviews of the neuropsychiatric safety of the smoking cessation medicines in relation to each other. In addition, there have been no recent cost-effectiveness analyses that have fully accounted for adverse events in order to determine which UK-licensed smoking cessation medicine is estimated to be the most cost-effective in UK settings. The aim of this study is to determine how smoking cessation medicines compare with each other with respect to their neuropsychiatric safety in adult smokers. Secondary aims include updating the evidence regarding the effectiveness and cardiovascular safety of these medicines for use in a cost-effectiveness analysis.

Methods and analysis

Criteria for screening studies

Study designs

For the safety network meta-analyses, RCTs of any duration will be included in addition to observational studies with control groups. Uncontrolled observational studies (eg, case reports and case series) will be excluded.

For the effectiveness network meta-analyses, we will include RCTs of greater than 6 months’ duration in any setting, including, but not limited to, primary care practices, hospitals including inpatient and outpatient clinics, universities, workplace clinics, nursing or residential homes. Multiarm trials will be included while crossover trials, non-randomised trials, quasi-randomised trials and interrupted time series analyses will be excluded from the effectiveness analyses.


We will include smokers aged 18 years and over of all ethnicities who are seeking to quit smoking using UK-licensed smoking cessation therapies. This includes adult smokers accessing local authority stop smoking services. We will also include smokeless tobacco users. We will exclude studies with participants less than 18 years of age as varenicline, bupropion and electronic cigarettes are only licensed for use in adults in the UK. Non-smoking populations will be excluded as well as pregnant and breastfeeding women, as varenicline and bupropion are not licensed for use in these groups in the UK. If sufficient evidence is identified, we plan to consider the following subgroups in all analyses: those with psychiatric illness (for example, depression, schizophrenia, bipolar disorder, substance misuse), cardiovascular disease (for example, peripheral vascular disease, acute coronary syndromes and postmyocardial infarction), chronic obstructive pulmonary disease, diabetics, heavy smokers (defined as people who smoke >20 cigarettes per day) and those with previous quit attempts.


The smoking cessation medicines that we will assess include varenicline, bupropion, nicotine replacement therapy and electronic cigarette as monotherapy and in combination treatment (eg, varenicline combined with NRT, varenicline combined with bupropion and bupropion compared with NRT). For NRT, combinations of different formulations given concurrently, for example, patch and gum, will also be assessed. Different dosages of treatments will also be examined (see online supplementary appendix 1 which summarise the main pharmacologic monotherapies for smoking cessation by formulation and dosage using the British National Formulary September 2016 version ( and the MHRA public assessment report for the ‘e-Voke’).5 Combination therapies and combinations of NRT formulations will also be included in the analyses.

10.1136/bmjopen-2016-015414.supp1Supplementary data:


We will exclude trials of alternative and complementary therapies (eg, hypnotherapy, acupuncture, aromatherapy and herbal therapies) and psychotherapies (unless they are included as cotreatment with a pharmacological intervention).


Safety analysis

The primary composite safety outcome will be serious adverse events, defined as events that resulted in death, were life threatening, required hospitalisation or resulted in significant disability or congenital/birth defect.31 Safety outcomes will be grouped under the following headings:

  • Neuropsychiatric outcomes. The primary neuropsychiatric outcomes will include: completed suicide, attempted suicide, suicidal ideation, depression and seizures. Secondary neuropsychiatric outcomes will include: abnormal dreams, aggression, anxiety, fatigue, insomnia, irritability, sleep disorders and somnolence.
  • Cardiovascular outcomes. The primary cardiovascular outcomes will include: cardiovascular death, non-fatal myocardial infarction (ie, unstable angina) and non-fatal stroke based on the FDA definition.32 Secondary cardiovascular outcomes will include: transient ischaemic attack, congestive heart failure, palpitations, arrhythmias and thromboembolism (deep vein thrombosis and pulmonary embolism).

Other outcomes will include adverse events such as nausea, headache, dry mouth, skin rash and pruritus.

Effectiveness analysis

The primary effectiveness outcome will be sustained smoking cessation, defined as abstinence for a minimum of 6 months as determined by biochemically validated continuous or prolonged abstinence at the longest reported time point in intention to treat analyses, as this is the strictest definition of abstinence. As we are using data from previous Cochrane reviews of smoking cessation medicines,33–36 we have also chosen this outcome to be consistent with the definitions used in those reviews. Where these data are not available, we will accept point prevalence abstinence and self-report quit data. We will treat participants who drop out or are lost to follow-up as continuing smokers. We will extract information on abstinence at each time point for which it is reported to allow a survival model to be estimated following the approach used by Chen et al 37 and Madan et al.38 Data on reductions in smoking, rather than abstinence, will not be included. Secondary outcomes will include reduction in craving and reduction in withdrawal symptoms.

Search strategy

We will search the following databases: MEDLINE, EMBASE, PsycINFO, Web of Science, and the Cochrane Databases including the Cochrane Database of Systematic Reviews, the Database of Abstracts and Reviews of Effectiveness (updated until March 2015), the Cochrane Central Register of Controlled Trials, the NHS Economic Evaluation Database and the Health Technology Assessment Database. Searches will be conducted with the help of an information specialist and will not include any language restrictions. Non-English language articles will be reviewed by native speakers prior to obtaining a full translation. We will also manually search the reference lists of relevant research articles and previous reviews and communicate with authors in an attempt to identify unpublished information; in a previous study, we had a 75% positive response rate from corresponding authors for studies published after 2006.17 We will also review the literature to identify disutilities and costs associated with neuropsychiatric and cardiovascular treatment-related adverse events. Acknowledging that we may not find many studies in a smoking cessation population, we will also search for studies reporting disutilities and costs for the same events in other populations.

To identify studies for the safety network meta-analyses, we will build on the basic search strategy included in the cardiovascular network meta-analysis by Mills et al 39 (see online supplementary appendix 2 for our full electronic search strategy for observational studies of varenicline in Medline). To identify studies for the effectiveness network meta-analyses, the search strategies from four Cochrane reviews33–36 (or updated versions where available) will be modified to identify more recent trials for inclusion in the current study in addition to their previously identified trials. Searches for observational studies will not be date limited. We will adapt the Sheffield economic model30 to incorporate disutilities associated with neuropsychiatric and cardiovascular treatment-related adverse events and update model inputs. The searches used for the network meta-analyses will be rerun with a cost-effectiveness filter to identify studies reporting information on utilities, disutilities, resource use and costs, which will be used to inform the economic evaluation.

Study selection and data extraction

Search results will be uploaded to Covidence,40 which we will use to screen abstracts and full text and to resolve disagreements. Reviewers (MND—all papers, KHT and DC—papers equally shared) will independently screen abstracts to determine whether full-text reports should be obtained. The same reviewers will independently identify eligible full-text reports for inclusion. Discrepancies will be resolved by reaching consensus among reviewers. We will include a PRISMA diagram41 to set out the results of the searches and to indicate the number of included and excluded trials. The reasons for excluding studies following full-text screening will be documented.

Data for studies included following the updated search will be extracted by one reviewer (MND) and checked by coreviewers (KHT and DC). Information will be collected on study design (duration of treatment, description of allocation concealment and blinding), study participants (inclusion and exclusion criteria, country, region and population studied), baseline characteristics (eg, ethnicity, sex and smoking history), intervention and comparison groups (including the smoking cessation intervention, whether or not there was cotreatment, dosage and formulation), our predefined primary and secondary outcomes of interest including measures of effectiveness and safety outcomes, losses to follow-up and study sponsor. All of the extracted information will be summarised in tables. In the event of missing data, we will contact authors by email to ask for original data. Authors of all newly identified studies will be contacted to verify the accuracy of the extracted data.

Risk of bias assessment

For RCTs, the Cochrane tool for assessing the risk of bias42 will be used to determine whether there is high, low or unclear risk of bias in the following domains: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment; incomplete outcome data, selective outcome reporting and other sources of bias. For observational studies, we will consider using the risk of bias in non-randomised studies of interventions tool43 to determine whether there is low, moderate, serious or critical risk of bias or no information in the following domains: confounding, participant selection, intervention classification, intervention deviations, missing data, outcome measurement and selection of the reported result. Reviewers (MND—all papers, KHT and DC—papers equally shared) will independently assess the risk of bias in each of the trials. Discrepancies will be resolved by referring to the original publication and reaching consensus among reviewers. Study authors will be contacted to obtain study protocols and additional information that may not have been published to aid with assessment of the risk of bias.

Data synthesis

Effectiveness outcomes will be summarised as risk ratios. Because safety outcomes are rare, we will follow recommendations of Bradburn et al 44 and use Peto ORs to compare treatment groups although we will also report risk differences. All results will be reported including 95% CIs. The pairwise and network meta-analyses will be conducted in a Bayesian framework using OpenBUGS software, using code developed by Dias et al.45 We will report results of both fixed-effect and random-effect meta-analyses; between-study heterogeneity will be quantified using the between-study SD (τ). For each separate outcome, we will also construct a network meta-analysis (NMA) that will be compared with the pairwise results. For the safety outcomes, separate analyses will be conducted for RCTs and observational studies. NMA is an extension of standard meta-analysis that allows evidence synthesis to be performed when there are multiple competing interventions available by simultaneously combining evidence from all trials reporting that outcome, so long as treatments form a connected network.46 Figure 1 shows an example of a connected network of seven smoking cessation treatments adapted from a Cochrane overview of reviews of smoking cessation at 6 months.14 For the NMA, combination therapies will be considered separate interventions but we will explore models for the effects of the component therapies using a main-effect model and a two-way interaction model (allowing pairs of therapies to have either a bigger or smaller effect than would be expected from the sum of their effects alone). For the random-effect NMA, we will assume homogeneous between-study variability across studies. We will assess the goodness of fit of each model to the data by calculating the posterior mean residual deviance. This is defined as the difference between the deviance for the fitted model and the saturated model, where the deviance measures the fit of the model using the likelihood function. The Deviance Information Criterion (DIC), which is equal to the sum of the posterior mean of the residual deviance and the effective number of parameters pD, will be used as a basis for model comparison.47 The DIC penalises the posterior mean residual deviance (a measure of model fit) by the effective number of parameters in the model (as measure of complexity) and can therefore be viewed as a trade-off between the fit and complexity of the model.

Figure 1
Network diagram for effectiveness of smoking cessation treatments. Adapted from Cahill et al.14 NRT, nicotine replacement therapy.

For the pairwise analyses only, and where the number of studies allow, we will produce funnel plots.

Assessment of the consistency assumption

Validity of a NMA depends on the assumption that there is no effect modification of the pairwise intervention effects or, that the prevalence of effect modifiers is similar in the different studies. This key assumption has been referred to variously as transitivity,48 similarity49 and consistency.50 We will compile a table of important trial and patient characteristics and visually inspect the ‘similarity’ of factors we consider likely to modify treatment effect.

We will visually inspect the network diagram to identify the extent of potential inconsistency (the number of loops) and use model fit and selection statistics to informally assess whether it is evident. If inconsistency is suspected, we will explore it formally using a ‘node-splitting’ approach.50

Health economic modelling

A previously built model30 will be used to evaluate cost-effectiveness using probabilistic methods and reporting fully incremental analyses that meet NICE reference case.51 This model has nine health states including those most commonly related to smoking. Where data allow the model will be adapted to allow more than one attempt at quitting and the addition of serious adverse neuropsychiatric and cardiovascular events.

Subgroup analyses will be presented as appropriate. Sensitivity analyses will be performed including and excluding smokeless tobacco users. We will use the Grading of Recommendations Assessment, Development and Evaluation approach to assess the quality of evidence.52Evidence for both effectiveness and safety outcomes will be judged for the domains of risk of bias, consistency, precision, reporting bias and directness. Evidence will be ranked as being of high, moderate, low or very low quality.


The proposed systematic review, network meta-analysis and cost-effectiveness analysis will address important questions about the relative costs or risks and benefits of different smoking cessation pharmacotherapies. It is expected that the study findings will be incorporated into future updates of the new NICE Public Health guidance on Smoking Cessation Interventions and Services, a partial update of NICE Public Health guidance on Smoking Cessation Services,4 expected to be published in November 2017. Critically, we believe that the study findings will offer patients, prescribers and regulators updated and comprehensive information on the safety and effectiveness of these smoking cessation medicines that will allow them to make informed decisions when evaluating or selecting a pharmacological treatment to assist with a quit attempt.

Ethics and dissemination

Ethics approval is not required for this evidence synthesis study as it involves analysis of secondary data from RCTs and observational studies. We anticipate dissemination to the following groups, for whom the results of this research will be of interest: the general public, clinicians and healthcare practitioners, academics, policy makers and industry. Findings from the study will be disseminated through conventional academic routes such as peer-reviewed publications and presentations and regional, national and international conferences.

Supplementary Material

Reviewer comments:
Author's manuscript:


Contributors: KHT, DC and NJW conceived the idea, planned and designed the study protocol. DC designed the network diagram. KHT, DC and NJW planned the data extraction and statistical analyses. NJW and MS planned the economic evaluation. MRM and DG provided critical insight. KHT and MND wrote the first draft of the protocol, and all authors approved and contributed to the final manuscript.

Funding: This project presents independent research which was funded by the National Institute for Health Research Health Technology Assessment Programme (project number NIHR HTA 15/58/18).

Disclaimer: The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the Health Technology Assessment Programme, NIHR, NHS or the Department of Health.

Competing interests: MRM reports grants from Pfizer, grants from Rusan and non-financial support from GlaxoSmithKline, outside the submitted work. DG had a specified relationship with the MHRA in the past (was a member of the MHRA’s Pharmacovigilance Expert Advisory Group and received travel expenses and a small fee for meeting attendance and preparation for meetings).

Patient consent: Detail has been removed from this case description/these case descriptions to ensure anonymity. The editors and reviewers have seen the detailed information available and are satisfied that the information backs up the case the authors are making.

Provenance and peer review: Not commissioned; externally peer reviewed.

Correction notice: This paper has been amended since it was published Online First. Owing to a scripting error, some of the publisher names in the references were replaced with 'BMJ Publishing Group'. This only affected the full text version, not the PDF. We have since corrected these errors and the correct publishers have been inserted into the references.


1. Peto R, Darby S, Deo H, et al. Smoking, smoking cessation, and lung Cancer in the UK since 1950: combination of national statistics with two case-control studies. BMJ 2000;321:323–9. [PMC free article] [PubMed]
2. Jha P, Peto R Global effects of smoking, of quitting, and of taxing tobacco. N Engl J Med 2014;370 68:60 doi:10.1056/NEJMra1308383 [PubMed]
3. Health and Social Care Information Centre. Statistics on smoking. 2012 England, 2012.
4. National Institute for Health and Clinical Excellence. NICE public health guidance 10. smoking cessation services in primary care, pharmacies, local authorities and workplaces, particularly for manual working groups, pregnant women and hard to reach communities. London: NICE, 2008.
5. Medicines & Healthcare products Regulatory Agency. Public assessment report. e-Voke 10mg and 15mg electronic inhaler (PL 42601/0003-4). Secondary public assessment report. e-voke 10mg and 15mg electronic inhaler (PL 42601/0003-4). 2015.
6. Medicines and Healthcare products Regulatory Agency. Varenicline:adverse psychiatric reactions, including depression. Drug Safety Update 2008;2:2–3.
7. US Food and Drug Administration. Information for healthcare professionals: varenicline (marketed as Chantix) and Bupropion (marketed as Zyban, Wellbutrin and generics. FDA Drug Safety Newsletter 2009.
8. Harrison-Woolrych M. Mental health effects of varenicline. BMJ 2015;350:h1168 doi:10.1136/bmj.h1168 [PubMed]
9. Anthenelli RM, Benowitz NL, West R, et al. Neuropsychiatric safety and efficacy of varenicline, bupropion, and nicotine patch in smokers with and without psychiatric disorders (EAGLES): a double-blind, randomised, placebo-controlled clinical trial. Lancet 2016;387:2507–20. doi:10.1016/S0140-6736(16)30272-0 [PubMed]
10. European Medicines Agency (EMA). Champix procedural steps taken and scientific information after the authorization. Secondary champix procedural steps taken and scientific information after the authorization. 2016.
11. Thomas KH, Martin RM, Davies NM, et al. Smoking cessation treatment and risk of depression, suicide, and self harm in the Clinical Practice Research Datalink: prospective cohort study. BMJ 2013;347:f5704 doi:10.1136/bmj.f5704 [PubMed]
12. Kotz D, Viechtbauer W, Simpson C, et al. Cardiovascular and neuropsychiatric risks of varenicline: a retrospective cohort study. Lancet Respir Med 2015;3:761–8. doi:10.1016/S2213-2600(15)00320-3 [PMC free article] [PubMed]
13. Action on Smoking and Health. Use of electronic cigarettes (vapourisers) among adults in Great Britain, 2016.
14. Cahill K, Stevens S, Perera R, et al. Pharmacological interventions for smoking cessation: an overview and network meta-analysis. Cochrane Database Syst Rev 2013;5:CD009329 doi:10.1002/14651858.CD009329.pub2 [PubMed]
15. Prescribing and Primary Care team Health and Social Care Information Centre. Prescription cost analysis, England 2013. 2014.
16. Tonstad S, Davies S, Flammer M, et al. Psychiatric adverse events in randomized, double-blind, placebo-controlled clinical trials of varenicline: a pooled analysis. Drug Saf 2010;33:289–301. doi:10.2165/11319180-000000000-00000 [PubMed]
17. Thomas KH, Martin RM, Knipe DW, et al. Risk of neuropsychiatric adverse events associated with varenicline: systematic review and meta-analysis. BMJ 2015;350:h1109. [PubMed]
18. Gibbons RD, Mann JJ, Varenicline MJJ Varenicline, smoking cessation, and neuropsychiatric adverse events. Am J Psychiatry 2013;170:1460-7 doi:10.1176/appi.ajp.2013.12121599 [PMC free article] [PubMed]
19. Moore TJ, Furberg CD, Glenmullen J, et al. Suicidal behavior and depression in smoking cessation treatments. PLoS One 2011;6:e27016 doi:10.1371/journal.pone.0027016 [PMC free article] [PubMed]
20. Harrison-Woolrych M, Ashton J Psychiatric adverse events associated with varenicline: an intensive postmarketing prospective cohort study in New Zealand. Drug Saf 2011;34:763–72. doi:10.2165/11594450-000000000-00000 [PubMed]
21. Kasliwal R, Wilton LV, Shakir SA Safety and drug utilization profile of varenicline as used in general practice in England: interim results from a prescription-event monitoring study. Drug Saf 2009;32:499–507. [PubMed]
22. Gunnell D, Irvine D, Wise L, et al. Varenicline and suicidal behaviour: a cohort study based on data from the General Practice Research Database. BMJ 2009;339:339. [PMC free article] [PubMed]
23. Meyer TE, Taylor LG, Xie S, et al. Neuropsychiatric events in Varenicline and nicotine replacement patch users in the Military Health System. Addiction 2013;108:203–10. doi:10.1111/j.1360-0443.2012.04024.x [PubMed]
24. Campbell AR, Anderson KD Mental health stability in veterans with posttraumatic stress disorder receiving varenicline. Am J Health Syst Pharm 2010;67:1832–7. doi:10.2146/ajhp100196 [PubMed]
25. Thomas KH, Martin RM, Potokar J, et al. Reporting of drug induced depression and fatal and non-fatal suicidal behaviour in the UK from 1998 to 2011. BMC Pharmacol Toxicol 2014;15:1–11. doi:10.1186/2050-6511-15-54 [PMC free article] [PubMed]
26. Davis S, King B, Raine JM Spontaneous reporting- UK : Mann RD, Andrews EB, Pharmacovigilance. Second Edition West Sussex: Chichester; John Wiley & Sons, 2007:199–215.
27. Martin RM, May M, Gunnell D Did intense adverse media publicity impact on prescribing of paroxetine and the notification of suspected adverse drug reactions? analysis of routine databases, 2001-2004. Br J Clin Pharmacol 2006;61:224–8. doi:10.1111/j.1365-2125.2005.02527.x [PMC free article] [PubMed]
28. Walker AM. Confounding by indication. Epidemiology 1996;7:335–6. [PubMed]
29. US Department of Health and Human Services. The Health Consequences of Smoking-50 years of Progress: a Report of the Surgeon General. Atlanta (GA: US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for chronic disease Prevention, Health Promotion Office on Smoking Health, 2014.
30. Leaviss J, Sullivan W, Ren S, et al. What is the clinical effectiveness and cost-effectiveness of cytisine compared with varenicline for smoking cessation? A systematic review and economic evaluation. Health Technol Assess 2014;18:1–120. doi:10.3310/hta18330 [PubMed]
31. Nakamura M, Oshima A, Fujimoto Y, et al. Efficacy and tolerability of Varenicline, an alpha4beta2 nicotinic acetylcholine receptor partial agonist, in a 12-week, randomized, placebo-controlled, dose-response study with 40-week follow-up for smoking cessation in japanese smokers. Clin Ther 2007;29:1040–56. doi:10.1016/j.clinthera.2007.06.012 [PubMed]
32. Hertzberg MA, Moore SD, Feldman ME, et al. A preliminary study of bupropion sustained-release for smoking cessation in patients with chronic posttraumatic stress disorder. J Clin Psychopharmacol 2001;21:94–8. [PubMed]
33. Cahill K, Lindson-Hawley N, Thomas KH, et al. Nicotine receptor partial agonists for smoking cessation. Cochrane Database Syst Rev 2016;5:CD006103 doi:10.1002/14651858.CD006103.pub7 [PubMed]
34. Hughes J R, Stead LF, Hartmann-Boyce J, et al. Antidepressants for smoking cessation. Cochrane Database of Syst Rev 2014;1. [PubMed]
35. Stead LF, Perera R, Bullen C, et al. Nicotine replacement therapy for smoking cessation. Cochrane database of syst rev 2012. [PubMed]
36. Hartmann-Boyce J, McRobbie H, Bullen C, et al. Electronic cigarettes for smoking cessation. Cochrane Database Syst Rev 2016;9 doi:10.1002/14651858.CD010216.pub3 [PubMed]
37. Chen YF, Madan J, Welton N, et al. Effectiveness and cost-effectiveness of computer and other electronic aids for smoking cessation: a systematic review and network meta-analysis. Health Technol Assess 2012;16:1–205. doi:10.3310/hta16380 [PubMed]
38. Madan J, Chen Y-F, Aveyard P, et al. Synthesis of evidence on heterogeneous interventions with multiple outcomes recorded over multiple follow-up times reported inconsistently: a smoking cessation case-study. J R Stat Soc Ser A Stat Soc 2014;177:295–314. doi:10.1111/rssa.12018
39. Mills EJ, Thorlund K, Eapen S, et al. Cardiovascular events associated with smoking cessation pharmacotherapies: a network meta-analysis. Circulation 2014;129:28–41. doi:10.1161/CIRCULATIONAHA.113.003961 [PMC free article] [PubMed]
40. Covidence systematic review softwareMelbourne, Australia: Veritas Health Innovation;
41. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ 2009;339:b2535. [PubMed]
42. Higgins JP, Altman DG, Gøtzsche PC, et al. The Cochrane Collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928. [PubMed]
43. Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of Bias in non-randomised studies of interventions. BMJ 2016;355:i4919. [PMC free article] [PubMed]
44. Bradburn MJ, Deeks JJ, Berlin JA, et al. Much ado about nothing: a comparison of the performance of meta-analytical methods with rare events. Stat Med 2007;26:53–77. doi:10.1002/sim.2528 [PubMed]
45. Dias S, Sutton AJ, Ades AE, et al. Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Med Decis Making 2013;33:607–17. doi:10.1177/0272989X12458724 [PMC free article] [PubMed]
46. Caldwell DM, Ades AE, Higgins JP Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 2005;331:897 doi:10.1136/bmj.331.7521.897 [PMC free article] [PubMed]
47. Spiegelhalter DJ, Best NG, Carlin BP, et al. Bayesian measures of model complexity and fit. J R Stat Soc Ser B Stat Soc 2002;64:583–639. doi:10.1111/1467-9868.00353
48. Salanti G, Higgins JP, Ades AE, et al. Evaluation of networks of randomized trials. Stat Methods Med Res 2008;17:279–301. doi:10.1177/0962280207080643 [PubMed]
49. Song F, Altman DG, Glenny AM, et al. Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses. BMJ 2003;326:472 doi:10.1136/bmj.326.7387.472 [PMC free article] [PubMed]
50. Dias S, Welton NJ, Caldwell DM, et al. Checking consistency in mixed treatment comparison meta-analysis. Stat Med 2010;29:932–44. doi:10.1002/sim.3767 [PubMed]
51. National Institute for Health and Clinical Excellence. Guide to the methods of Technology appraisal. London: NICE, 2013. 2013.
52. Guyatt GH, Oxman AD, Vist GE, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924–6. doi:10.1136/bmj.39489.470347.AD [PMC free article] [PubMed]

Articles from BMJ Open are provided here courtesy of BMJ Publishing Group