Search tips
Search criteria 


Logo of bmjThis ArticleThe BMJ
BMJ. 2004 December 11; 329(7479): 1360.
PMCID: PMC535440

Trial protocols at the BMJ

Authors must submit the protocol with the trial
Giselle Jones, assistant editor BMJ and Kamran Abbasi, acting editor BMJ

Moves to improve the conduct and reporting of clinical trials have gathered pace this year. One issue that the BMJ has long grappled with is what to do about protocols of trials, and we announce a new policy that begins in January 2005.

Medical research should begin with a protocol that details the hypothesis, objectives, and methodology to be used in the study. Ideally the study should not deviate from the protocol, but in reality it often does. Sometimes deviating from the protocol is unavoidable—for example, when new evidence is published independently during the trial which invalidates the specified outcome. In other instances, protocol deviation may represent suppression of unfavourable findings in favour of reporting favourable ones.

Evidence of bias has been limited to case reports,1,2 but now we have research that begins to quantify the problem.3-5 Chan et al compared the completeness of outcomes reported in protocols versus outcomes reported in published research.4 Their cohort study showed that about 50% of efficacy outcomes and 65% of harms per trial were incompletely reported, and 62% of trials had at least one primary outcome that was added, changed, or removed compared with the protocol. That 86% of the authors surveyed denied the existence of unreported outcomes implies that the extent of reporting bias may be even greater. These findings are supported by two further studies, which show that selective and incomplete reporting of outcomes in published randomised controlled trials is common.3,5

The desire to eliminate bias in reporting research has prompted important initiatives over the last decade. These have culminated in the use of the CONSORT statement (the Consolidated Standards of Reporting Trials) and other guidelines such as QUOROM (Quality of Reporting of Meta-analyses).6,7 The CONSORT checklist stipulates that deviations in the protocol should be described including reasons for doing so. Randomised controlled trials submitted to the BMJ must be reported in accordance with the CONSORT statement and checklist. We require a declaration that the decision to publish was controlled by the authors and not the trial sponsor.8 From July 2005 all trials will also need to be registered with a suitable trial registry.9 Now authors must submit the trial protocol with their manuscript submission, and we will not send the manuscript to an external reviewer unless we have the protocol.

Our experience of chasing authors for trial protocols, when we have suspected deviation in the protocol or found it hard to fathom what the authors set out to do, has been miserable. Authors are reluctant to send us the protocol, and the review process can be considerably delayed. Our electronic manuscript submission system allows additional documents to be uploaded as supplementary data files, and we ask authors to add the protocol to their manuscript submission in this way. BMJ editors and reviewers of that particular manuscript will be able to see the protocol on our system and refer to it as necessary. We do not intend to publish the protocols at this stage.

We are not offering peer review of protocols as the Lancet does,10 although we may offer this in future. We are currently conducting research into what kind of protocol review trialists favour. In the meantime, we believe that identifying deviation from the protocol is another important step in ensuring that the findings of a study are reported with honesty and transparency.


Competing interests: None declared.


1. West RR, Jones DA. Publication bias in statistical overview of trials: example of psychological rehabilitation following myocardial infarction [abstract]. In: Proceedings of the Second International Conference on the Scientific Basis of Health Services and Fifth International Cochrane Colloquium, Amsterdam, Netherlands, 8-12 October, 1997.
2. McCormack K, Scott NW, Grant AM. Outcome reporting bias and individual patient data meta-analysis: a case study in surgery [abstract]. In: Abstracts for Workshops and Scientific Sessions, Ninth International Cochrane Colloquium, Lyons, France, 9-13October, 2001.
3. Chan A, Krleza-Jeric K, Schmid I, Altman D. Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. CMAJ 2004;171: 735-40. [PMC free article] [PubMed]
4. Chan A, Hróbjartsson A, Haahr M, Gøtzsche P, Altman D. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA 2004;291: 2457-65. [PubMed]
5. Chan A, Altman D. Outcome reporting bias in randomised trials on PubMed: evidence from publications and trialists. BMJ (in press). [PMC free article] [PubMed]
6. Begg CB, Cho MK, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA 1996;276: 637-9. [PubMed]
7. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF, for the QUOROM Group. Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Lancet 1999;354: 1896-900. [PubMed]
8. Smith R. Maintaining the integrity of the scientific record. BMJ 2001;323: 588. [PMC free article] [PubMed]
9. Abbasi K. Compulsory registration of clinical trials. BMJ 2004;329: 637-8. [PMC free article] [PubMed]
10. McNamee D. Protocol reviews at the Lancet. Lancet 1997;350: 6.

Articles from The BMJ are provided here courtesy of BMJ Group