PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of bmcmrmBioMed Centralsearchsubmit a manuscriptregisterthis articleBMC Medical Research Methodology
 
BMC Med Res Methodol. 2017; 17: 145.
Published online 2017 September 18. doi:  10.1186/s12874-017-0424-3
PMCID: PMC5604493

Patients’ beliefs regarding informed consent for low-risk pragmatic trials

Abstract

Background

The requirement to obtain written informed consent may undermine the potential of pragmatic randomized clinical trials (pRCTs) to improve evidence-based care. This requirement could compromise trials statistical power or even force it to close them down prematurely. However, recent data from the U.S. and Spain suggest that a majority of the public endorses written consent for low-risk pRCTs. The present manuscript assesses whether this view is shared by patients.

Methods

This was a cross-sectional, probability-based survey, with a 2 × 2 factorial design, assessing support for written informed consent versus verbal consent or general notification for two low-risk pRCTs in hypertension, one comparing 2 drugs with similar risk/benefit profiles and the other comparing the same drug being taken in the morning or at night. This web-based survey was conducted in May 2016. Two-thousand and eight adults who were representative of the Spanish population participated in the survey (response rate: 61%). Of these 2008 respondents, 338 indicated that they had been diagnosed with hypertension and were being treated with prescription medicines for this condition at the time of responding to the survey. The primary outcome measures were respondents’ personal preference and recommendation to a research ethics committee regarding the use of written informed consent versus verbal consent or general notification.

Results

Overall, 74% of the 338 patient respondents endorsed written consent. In both scenarios, general notification received significantly more support (30.6%-44.7%) than verbal consent (13.3%-17.6%). 43% of respondents preferred and/or recommended general notification rather than written consent.

Conclusions

As in the survey of the general public, more patients endorsed written consent than the alternative option. However, two factors suggest that a different approach to written consent should be investigated for low-risk pRCTs: a) a substantial minority of respondents supported general notification, b) data from the US have shown that most patients who prefer written consent are willing to forego it if obtaining written consent makes the trial too difficult to be conducted; and c) 2016 CIOMS guidelines endorse waivers of consent when the trial fulfills specific conditions. Surveys in other EU countries are needed to assess what patients believe towards pRCTs. If similar results to that reported in this study are found, it is foreseeable that with educational efforts, general notification could be an acceptable and widespread approach to the conduct of low-risk pRCTs.

Electronic supplementary material

The online version of this article (10.1186/s12874-017-0424-3) contains supplementary material, which is available to authorized users.

Keywords: Survey, Low-risk pragmatic trials, Written informed consent, Verbal informed consent, General notification, Clinical trials regulation, Low-intervention clinical trials

Background

Recruiting a sufficient number of participants is a common problem for clinical trials. Insufficient recruitment can reduce statistical power, waste resources, increase costs and even result in the premature termination of a trial [13]. Acknowledging that appropriately informing potential trial participants is a key ethical principle in clinical research, seeking written informed consent could jeopardize the conduct of clinical trials. In response, a number of studies have assessed if modifications to the consent form and/or the consent process could ease participants’ recruitment [4]. On the other hand, there is scarce empirical evidence of what type of information potential research participants want to know about the study: for instance, only 39% and 76% of potential participants wanted to be told about voluntariness and the purpose of the study, respectively [5].

Currently, in both the US and EU clinical trials regulations, and for all types of trials, except for cluster-randomized trials, written informed consent is asked from all participants. This requirement creates huge challenges to many pragmatic randomized controlled trials (pRCTs) preventing the appropriate conduct of many of them due to insufficient or biased recruitment [6]. Research ethics committees (RECs) could adapt current informed consent requirements to the specific needs of the research, as was the case in two pRCTs conducted in the UK with commonly prescribed medications where short (2-page) participants information sheets where used to inform potential participants [7]. However, with current regulations, RECs could never change to a verbal consent, or waived participant’s consent in the conduct of pRCTs assessing the comparative effectiveness of commercially available medications. These two alternatives to written informed consent (verbal consent or general notification, i.e., a non-specific informed consent approach), however, have been shown to be supported by substantial minorities of the general public in the US and Spain when being asked on hypothetical low-risk pRCTs with commonly prescribed drugs [8,9]. It is important to understand whether having a chronic condition might influence individual views on written informed consent for low-risk pRCTs, of special interest since this type of trial will be frequently conducted for the assessment of commonly prescribed drugs.

Methods

Two thousand and eight adults participated in a survey conducted in Spain in May 2016, that replicated a previous survey that was conducted in the US [8]. The Spanish survey was administered to individuals belonging to Netquest (GfK group) panel (https://www.netquest.com/es/home/encuestas-online-investigacion). This panel comprises almost 200.000 people. Adult Spaniards with internet access are invited to join (‘single-use’ invitation) with the goal of ensuring a representative sample of the non-institutionalized civilian Spanish population. This was a probability-based online panel –except for the oldest (≥75 years) age group which is less represented than in the general population. The design, conduct and results of the survey have been explained in detail elsewhere [9].

The survey used a cross-sectional, 2 × 2 factorial design (Table 1). The survey started by explaining a hypothetical hospital in which all patients were informed through letters, brochures and posters on the simultaneous provision of care and the conduct of research (Additional file 1). Two hypothetical scenarios were assessed: two low-risk pRCTs in hypertension, comparison of 2 drugs with similar risk/benefit ratio or taking the same drug in the morning or at night. Each scenario had two routes: written consent vs verbal consent; written consent vs general notification. Each respondent was randomized to one of the 4 routes.

Table 1
Experimental design of the survey (Modified from Nayak et al. [8])

In the hypothetical scenarios presented to respondents, the primary outcome measures were the respondent’s recommendation to the REC (“If you were to give advice to the REC, would you recommend written consent or general notification/verbal consent?”) and the respondent’s preference (“If you were a patient in this hospital, which would you personally prefer, written consent or general notification/verbal consent?”). Responses to both questions were ‘definitely’ or ‘probably’ for both written consent and the alternative option.

Respondents were asked to evaluate the trial by indicating whether they agree, using a 7-point scale (1 = strongly disagree, 7 = strongly agree), with the following three statements: a) “It is valuable to study whether one treatment option is more effective than the other for treating high blood pressure”; b) “Patients who participate in the randomized trial face greater risks than patients who receive usual care”; and c) “Patients who participate in the randomized trial are more likely to improve (lower) their high blood pressure than patients who receive usual care”.

Since both of the theoretical pRCTs involved hypertension, participants were asked to report on whether they have been diagnosed with hypertension and whether they were receiving treatment with prescription medications. This article reports on the results obtained in the 338 respondents who indicated that they had been diagnosed with hypertension and were being treated at the time of responding to the survey.

Statistical analysis

Recommendations to the REC and personal preferences for written consent or the alternative approach were dichotomized. Logistic regression models were used to assess whether the pRCT scenario and alternative consent/notification option were associated with respondents’ recommendations and personal preferences. The models included main effects for the research scenario (drug pRCT vs. dose-timing pRCT) and the alternative option (general notification; verbal consent), as well as the interaction of the 2 factors. To evaluate the association between respondents’ perceptions of the study’s value, risk, and benefit and support for the alternative option, the Pearson chi-square test of independence corrected for bootstrap was used.

All analyses were conducted in IBM SPSS statistics, version 21. According to final sample distribution, post-stratification weights were not used. Statistical significance was defined as a P value less than 0.05, and all tests were 2-sided.

Results

The survey was forwarded to 3298 panel members and started by 2243, of which 45 dropped out before they were randomized to one of the two pRCTs scenarios. After randomization, 179 were excluded for nonresponses to one of the two alternative options (written consent vs general notification or written consent vs verbal consent). Finally, 11 individuals were excluded for not responding to both primary outcomes (recommendation to the REC and personal preference), leaving 2008 panelists completers (response rate: 60.9%). The 338 respondents who indicated that they had been diagnosed with hypertension and were being treated with prescription medicines for this condition at the time of the survey (Fig. 1), were almost evenly distributed into the 4 groups and did not show statistically significant differences in any of the assessed characteristics (Table 2). Some 35% of these 338 respondents were ≥65 years old, quite different from the Spanish hypertensive population, of which 49% belong to this age group [10].

Fig. 1
Study flow diagram. HT: hypertensive
Table 2
Characteristics of the 338 hypertensive respondents by scenario and group

Recommendations to the REC and personal preferences

Overall, 74.3% of all the respondents would definitely or probably recommend use of written consent to the REC (Fig. 2a). In the drug pRCT, 31.8% would recommend general notification, whereas 17.6% would recommend verbal consent. In the dose-timing pRCT, 40.0% would recommend general notification, whereas 13.3% would recommend verbal consent instead of written consent.

Fig. 2
Recommendations to the research ethics committee (top) and personal preferences (bottom) for written consent and the alternative option. 2a.-Recommendation ro research ethics committee. 2b.-Personal preference. CI: Confidence interval; L: Lower limit; ...

Overall, 74% of all respondents would definitely or probably prefer the use of written consent (Fig. (Fig.2b).2b). In the drug pRCT, 30.6% prefer general notification, whereas 15.3% prefer verbal consent. In the dose-timing pRCT, 44.7% prefer general notification, whereas 13.3% prefer verbal consent instead of written consent. Fig. 3 shows respondents’ recommendations to the REC and their personal preferences.

Fig. 3
Support for alternative options to written consent. CI: Confidence interval; L: Lower limit; U. Upper limit; RCT: Randomized controlled trial

Considering only those 170 respondents who were presented with the option of written consent or general notification in the drug pRCT and the dose-timing pRCT scenarios, 42.9% preferred and/or recommended general notification to the REC. Among the 168 respondents who were presented with the option of verbal consent or written consent, 16.1% preferred and/or recommended verbal consent.

Responses to the 2 items were consistent across the groups, with most (from 87.1% to 100%) having the same recommendation and personal preference (Table 3). In the dose-timing pRCT consistency is statistically significantly greater (100% vs 88.3%; p = 0.001) when verbal consent is the alternative option instead of general notification. In both scenarios (drug RCT and dose-timing RCT) the percentage of respondents who preferred and/or recommended the alternative option is statistically significantly higher when the alternative is general notification rather than verbal consent (37.6% vs 18.8%, p = 0.005, in drug RCT; and 48.2% vs 17.3%, p < 0.001 in dose-timing RCT). The percentage of respondents who preferred the alternative option was not statistically significantly different in any of the 4 groups compared with the percentage of respondents that would recommend the alternative option to the REC (Fig. (Fig.33).

Table 3
Cross tabulation of respondents’ recommendation to the research ethics committee (REC) and personal preferences

A logistic regression model was used to test the effect of the experimental design of the survey on recommendations for using the alternative option over written consent. As mentioned above, the main effect is the alternative option presented: in both scenarios, drug pRCT and dose-timing pRCT, a statistically significant higher percentage of respondents recommended and preferred the alternative option of general notification rather than verbal consent (p < 0.001). The likelihood to recommend general notification to the REC is close to 4 times higher than verbal consent in the dose-timing pRCT scenario (OR = 3.712; p < 0.001) and almost 3 times higher in the drug pRCT scenario (OR = 2.910, p < 0.001). Similarly, the likelihood of preferring general notification is close to 4 times higher than verbal consent in the dose-timing pRCT scenario (OR = 3.974; p < 0.001) and almost 3 times higher in the drug pRCT scenario (0R = 2.724, p < 0.001). A table with the logistic regression analysis is shown in Additional file 2.

Views of pragmatic RCT scenarios

A large majority of respondents agreed that the described trial was valuable, with no statistically significant differences between the two scenarios: 90.6% in drug pRCT, 93.5% in dose-timing pRCT (Table 4). Some 36% and 48% of respondents in both scenarios believed that trial participants would face greater risks and greater potential benefit, respectively, than those receiving usual care.

Table 4
Views of the hypertensive patients on statements about social value, risk and benefit of the pragmatic randomized controlled trial (pRCT) scenarios

Discussion

The majority (74%) of patients participating in this survey endorsed written informed consent for low-risk pRCTs. This finding is similar to the results found in the general population [9] (77% supported written consent) and suggests that being affected by the condition under study does not affect respondents’ beliefs regarding the need to obtain written informed consent for low-risk pRCTs. In particular, patients were not more willing to accept an alternative to written informed consent compared to the general population.

The responses observed in the Spanish general population [9] and in the patients were rather similar, although a few slightly differences were noted. Although the percentages of respondents who recommended and/or preferred the alternative option were similar in the general population (40%) and the hypertensive patients (43%), the patients were more likely to have consistent responses between their preference and their recommendation to the REC (22.2% versus 17.7%) [9]. Similarly, the hypertensive patients had somewhat worse understanding of the perceived risks and benefits of being enrolled in a clinical trial: 36% of hypertensives (vs 32% in the general population) thought participating in a RCT poses more risks than usual care, whereas 48% of hypertensive respondents (vs 43%) believed participating in a RCT offers greater potential benefits. The different age distribution (hypertensive patients sample being much older) might help to explain these two differences; this could be object of a future study.

These present results are somewhat surprising. Limited available data on what patients (120 respondents of an online survey) believed regarding consent to participate in a hypertension drug low-risk pRCT, found that only 38% of respondents endorsed written consent and 42% endorsed verbal consent. In contrast, 21% indicated that broad notification was sufficient (16%) or no notification (5%) was needed [11]. The relatively high percentage of respondents in our survey supporting general notification (43%) versus written consent may be explained, in part, by the high trust the Spanish population has in physicians (95%) and in the universal public National Health Service (75%) [12], where the hypothetical scenarios were placed.

To the best of our knowledge, this is the first study conducted in any EU Member State assessing the opinion of patients with regards to written informed consent for low-risk pRCTs. However, it has several important limitations. First, as with the parent survey [9], the response rate was 61%, and it is not possible to determine whether non-respondents might differ from respondents; in addition, framing effects and the use of hypothetical scenarios might have influenced respondents’ attitudes -notably, the hypothetical scenarios, involving pRCTs conducted in clinical settings, likely were unfamiliar to many respondents. Second, the age distribution of this study sample is quite different from that of the Spanish hypertensive population: whereas 49% of hypertensive patients in Spain are ≥65 years old [9], in this study only 35% were in this age group. Third, we relied on self-report for whether the respondents were diagnosed with hypertension and whether they were taking medication. Finally, the study design did not allow us to assess directly which alternative method (verbal consent or general notification) respondents would prefer or recommend.

The informed consent process is not “one size fits all” and should be tailored to context [13]. In some cases it can even be waived. Thus, the recently issued CIOMS guidelines endorse the waiver of participant’s informed consent when the three following conditions are satisfied: a) the research is not practicable without the waiver; b) the research has important value; and c) the research poses no more than minimal risk to participants; in any case, the relevant REC must approve the waiver of informed consent [14]. Many low-risk pRCTs could fulfill these three conditions since, a) requiring informed consent to participants might jeopardize its correct conduct, since it is a barrier to unselected participant recruitment [15]; b) when a trial helps policy makers determine which options to fund in National Healthcare Systems [16], the (public) value of the trial is out of question, and c) low-risk pRCTs typically pose no incremental risk (i.e., no more than minimal risk) compared to clinical care [17]. pRCTs that would easily fulfill these three criteria are those conducted with commercially available medications and using routing electronic health records, also known as point-of-care trials [7, 1821]. The conduct of this type of pRCTs will most likely be fostered if investigators show to RECs the fulfillment of these three conditions. However, the EU new clinical trials regulations do not take into account the possibility of a waiver of the classical written informed consent except for cluster-RCTs [22].

It seems clear that to ensure the proper conduct and recruitment of participants to low-risk pRCTs there is a need to identify new approaches to written informed consent that should end-up with the amendment of current clinical trials regulations [23]. Two different approaches have been proposed in the US when considering low-risk pRCTs when clinical research is integrated in medical care: one supports asking for patient’s verbal consent to participate after explaining that randomization will decide participant’s treatment [24]; whereas the other strongly believes there is no need to ask for specific consent [25, 26].

Conclusion

Future surveys are needed within the EU member states addressing patients’ beliefs with regards to informed consent in low-risk pRCTs and, very importantly, to know if their beliefs would change if they were aware that the trial could not be conducted as expected if participants’ written informed consent is sought. This is relevant since a majority of both US patients [11] and public [27] endorsing written or verbal consent for low-risk pRCTs changed their minds if consent poses huge difficulties to the conduct of such trials and would accept general or no notification. Now that the conduct of low-risk pRCTs with no participant’s consent could be ethically acceptable in certain circumstances [14], it would be appropriate to know what EU patients believe on this subject so regulators could know what the society they serve is expecting. However, it should be acknowledged that most (if not all) RECs in the EU will reject on legal grounds the approval of a low-risk pRCT asking for a waiver of participants’ consent until EU clinical trials regulation is appropriately amended.

Additional files

Additional file 1:(34K, docx)

Survey Questionnaire (DOCX 33 kb)

Additional file 2:(16K, docx)

Recommendation to research ethics committee and personal preference: written consent or alternative option. Logistic regression (DOCX 14 kb)

Additional file 3:(56K, xlsx)

Anonymous participant level data (XLSX 50 kb)

Acknowledgements

We are grateful to the 338 anonymous respondents who participated in the survey.

Funding

This work was supported in part by the Victor Grifols i Lucas Foundation (Barcelona, Spain: http://www.fundaciogrifols.org/en/web/fundacio/home) -devoted to promote bioethics in the field of human health-, that had no role in the design of the study; analysis or interpretation of the data; preparation, review or approval of the manuscript; or the decision to submit the manuscript for publication. The opinions expressed in this article are those of the authors and may not reflect the opinions of the organizations that they work for.

Wendler is a NIH employee. The present work was funded in part by intramural research funds of the U.S. NIH Clinical Center. However, the views expressed are the authors’ own. They do not represent the position or policy of the NIH, the DHHS, or the U.S. government.

Availability of data and materials

The data set (anonymous participant level data) of this article is included within the article as Additional file 3.

Abbreviations

CIOMS
Council for International Organizations of Medical Sciences (Geneva, Switzerland)
pRCT
Pragmatic randomized controlled trial
RCT
Randomized controlled trial
EU
European Union

Authors’ contributions

Authors’ contributions

RDR conceived the idea and wrote the first draft of the manuscript. AJC, XC and DW made substantial revisions for intellectual content. All authors approved the final version of the manuscript and are accountable for all aspects included in it.

Notes

Ethics approval and consent to participate

The study protocol was reviewed by the research ethics committee of the Universidad Autónoma de Madrid (Madrid, Spain), which granted approval on March 14, 2016 (Ref. # CEI-70-1265). All anonymous participants consented to participate by responding to the survey.

Consent for publication

NA

Competing interests

None to declare except for financial support mentioned in “Funding”. Dal-Ré and Carné are trustees of the Victor Grifols i Lucas Foundation. The authors declare that they have no competing interest

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Footnotes

Electronic supplementary material

The online version of this article (10.1186/s12874-017-0424-3) contains supplementary material, which is available to authorized users.

References

1. McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9. doi: 10.1186/1745-6215-7-9. [PMC free article] [PubMed] [Cross Ref]
2. Damen L, van Agt F, de Boo T, Huysmans F. Terminating clinical trials without sufficient subjects. J Med Ethics. 2012;38:413–416. doi: 10.1136/medethics-2011-100020. [PubMed] [Cross Ref]
3. Kasenda B, von Elm E, You J, Blümle A, Tomonaga Y, Saccilotto R, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. 2014;311:1045–1051. doi: 10.1001/jama.2014.1361. [PubMed] [Cross Ref]
4. Treweek S, Mitchell E, PitkethlyM CJ, KjeldstrømM JM, et al. Strategies to improve recruitment to randomised controlled trials. Cochrane Database System Rev. 2010;4:MR000013. [PubMed]
5. Kirkby HM, Calvert M, Draper H, Keeley T, Wilson S. What potential research participants want to know about research: a systematic review. BMJ Open. 2012;2:e000509. doi: 10.1136/bmjopen-2011-000509. [PMC free article] [PubMed] [Cross Ref]
6. Sugarman J, Califf RM. Ethics and regulatory complexities for pragmatic clinical trials. JAMA. 2014;311:2381–2382. doi: 10.1001/jama.2014.4164. [PubMed] [Cross Ref]
7. Staa TP, Goldacre B, Gulliford M, Cassell J, Pirmohamed M, Taweel A, et al. Pragmatic randomised trials using routine electronic health records: putting them to the test. BMJ. 2012;344:e55. doi: 10.1136/bmj.e55. [PubMed] [Cross Ref]
8. Nayak RK, Wendler D, Miller FG, Kim SY. Pragmatic randomized trials without standard informed consent?: a National Survey. Ann Intern Med. 2015;163:356–364. doi: 10.7326/M15-0817. [PMC free article] [PubMed] [Cross Ref]
9. Dal-Ré R, Carcas A, Carné X, Wendler D. Public preferences on written informed consent for low-risk pragmatic clinical trials in Spain. Br J Clin Pharmacol. 2017;83:1921–1931. doi: 10.1111/bcp.13305. [PMC free article] [PubMed] [Cross Ref]
10. Banegas JR, Graciani A, de la Cruz-Troca JJ, León-Muñoz LM, Guallar-Castillón P, Coca A, et al. Achievement of cardiometabolic goals in aware hypertensive patients in Spain: a nationwide population-based study. Hypertension. 2012;60:–898, 905. [PubMed]
11. Kraft SA, Cho MK, Constantine M, Lee SS, Kelley M, Korngiebel D, et al. A comparison of institutional review board professionals' and patients' views on consent for research on medical practices. Clin Trials. 2016;13:555–565. doi: 10.1177/1740774516648907. [PMC free article] [PubMed] [Cross Ref]
12. Ferrandiz JP. La confianza institucional remonta en 2016, salvo la universidad, la banca, los sindicatos y las grandes empresas. [Institutional trust remounts in 2016, with the exception of universities, banks, trade unions and large corporations] Metroscopia. http://metroscopia.org/sistema-educativo-sindicatos-bancos-y-grandes-empresas-pierden-la-batalla-de-la-confianza-de-los-espanoles/. Accessed 13 Sept 2017.
13. Grady C. The changing face of informed consent. N Engl J Med. 2017;376:857–859. doi: 10.1056/NEJMra1603773. [Cross Ref]
14. Council for International Organizations of Medical Sciences (CIOMS). International Ethical Guidelines for Health-related Research involving Humans. Geneva. 2016. https://cioms.ch/wp-content/uploads/2017/01/WEB-CIOMS-EthicalGuidelines.pdf. Accessed 13 Sept 2017.
15. Ford I, Norrie J. Pragmatic Trials. N Engl J Med. 2016;375:454–63. [PubMed]
16. Garattini S, Jakobsen JC, Wetterslev J, Bertelé V, Banzi R, Rath A, et al. Evidence-based clinical practice: overview of threats to the validity of evidence and how to minimise them. Eur J Intern Med. 2016;32:13–21. doi: 10.1016/j.ejim.2016.03.020. [PubMed] [Cross Ref]
17. Lantos JD, Wendler D, Septimus E, Wahba S, Madigan R, Bliss G. Considerations in the evaluation and determination of minimal risk in pragmatic clinical trials. Clin Trials. 2015;12:485–493. doi: 10.1177/1740774515597687. [PMC free article] [PubMed] [Cross Ref]
18. Carcas AJ, Abad Santos F, Sánchez Perruca L, Dal-Ré R. Electronic medical record in clinical trials of effectiveness of drugs integrated in clinical practice. Med Clin (Barc) 2015;145:452–457. doi: 10.1016/j.medcli.2015.01.028. [PubMed] [Cross Ref]
19. Winhusen T, Wilder C, Wexelblatt SL, Theobald J, Hall ES, Lewis D, et al. Design considerations for point-of-care clinical trials comparing methadone and buprenorphine treatment for opioid dependence in pregnancy and for neonatal abstinence syndrome. Contemp Clin Trials. 2014;39:158–165. doi: 10.1016/j.cct.2014.08.009. [PubMed] [Cross Ref]
20. Shih MC, Turakhia M, Lai TL. Innovative designs of point-of-care comparative effectiveness trials. Contemp Clin Trials. 2015;45(Pt A):61–68. doi: 10.1016/j.cct.2015.06.014. [PMC free article] [PubMed] [Cross Ref]
21. -US Department of Veterans Affairs. Office of Research & Development. Point-of-care research. http://www.research.va.gov/services/csrd/point-of-care.cfm.
22. -Regulation (EU) No. 536/2014 of the European Parliament and of the Council of 16 of April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001/20/EC. Official Journal of the European Union L 158/1-76. 27 May 2014. http://ec.europa.eu/health/files/eudralex/vol-1/reg_2014_536/reg_2014_536_en.pdf. Accessed 13 Sept 2017.
23. McKinney RE Jr, Beskow LM, Ford DE, Lantos JD, McCall J, Patrick-Lake B, et al. Use of altered informed consent in pragmatic clinical research. Clin Trials. 2015;12:494–502. [PMC free article] [PubMed]
24. Kim SY, Miller FG. Informed consent for pragmatic trials--the integrated consent model. N Engl J Med. 2014;370:769–772. doi: 10.1056/NEJMhle1312508. [PubMed] [Cross Ref]
25. Faden R, Kass N, Whicher D, Stewart W, Tunis S. Ethics and informed consent for comparative effectiveness research with prospective electronic clinical data. Med Care. 2013;51(suppl 3):S53–S57. doi: 10.1097/MLR.0b013e31829b1e4b. [PubMed] [Cross Ref]
26. Faden RR, Beauchamp TL, Kass NE. Informed consent, comparative effectiveness, and learning health care. N Engl J Med. 2014;370:766–768. doi: 10.1056/NEJMhle1313674. [PubMed] [Cross Ref]
27. Cho MK, Magnus D, Constantine M, Lee SS, Kelley M, Alessi S, et al. Attitudes toward risk and informed consent for research on medical practices: a cross-sectional survey. Ann Intern Med. 2015;162:690–696. doi: 10.7326/M15-0166. [PMC free article] [PubMed] [Cross Ref]

Articles from BMC Medical Research Methodology are provided here courtesy of BioMed Central