PMCCPMCCPMCC

Search tips
Search criteria 

Advanced

 
Logo of mayoclinprocLink to Publisher's site
 
Mayo Clin Proc. May 2012; 87(5): 424–429.
PMCID: PMC3538468
Ten Recommendations for Closing the Credibility Gap in Reporting Industry-Sponsored Clinical Research: A Joint Journal and Pharmaceutical Industry Perspective
Bernadette A. Mansi,a Juli Clark,b Frank S. David,c Thomas M. Gesell,de Susan Glasser,f John Gonzalez,g Daniel G. Haller,h Christine Laine,i Charles L. Miller,a LaVerne A. Mooney,j and Maja Zecevick[low asterisk]
aGlaxoSmithKline, King of Prussia, PA
bAmgen, Thousand Oaks, CA
cLeerink Swann Consulting, LLC, Boston, MA
dNovartis Pharmaceuticals Corporation, East Hanover, NJ
eInternational Society for Medical Publication Professionals, Briarcliff Manor, NY
fJohnson & Johnson Pharmaceutical Research & Development, LLC, Raritan, NJ
gAstraZeneca, Macclesfield, United Kingdom
hJournal of Clinical Oncology, Alexandria, VA
iAnnals of Internal Medicine, Philadelphia, PA
jPfizer Medical, New York, NY
kThe Lancet, Elsevier, New York, NY
Maja Zecevic: M.Zecevic/at/Lancet.com
[low asterisk]Correspondence: Address to Maja Zecevic, PhD, MPH, 360 Park Ave S, New York, NY 10010 ; M.Zecevic/at/Lancet.com
Abbreviations and Acronyms: CONSORT, Consolidated Standards of Reporting Trials; ICMJE, International Committee of Medical Journal Editors; MPIP, Medical Publishing Insights and Practices
The credibility of industry-sponsored clinical research has suffered in recent years, undercut by reports of selective or biased disclosure of research results, ghostwriting and guest authorship, and inaccurate or incomplete reporting of potential conflicts of interest.1,2 In response, many pharmaceutical companies have integrated best practices and recommendations from groups such as the International Committee of Medical Journal Editors (ICMJE), the Good Publication Practice guidelines, the Committee on Publication Ethics, the EQUATOR (Enhancing the QUAlity and Transparency Of health Resources) Network, and the Medical Publishing Insights and Practices (MPIP) initiative into their internal policies and standard operating procedures.3-10 However, a credibility gap remains: some observers, including some journal editors and academic reviewers, maintain a persistent negative view of industry-sponsored studies.11 Given industry's pivotal role in the development of new therapies, further improvements in research conduct and disclosure are needed across the industry-investigator-editor enterprise to restore confidence in industry-sponsored biomedical research.
In 2008, the MPIP was founded by members of the pharmaceutical industry and the International Society for Medical Publication Professionals to elevate trust, transparency, and integrity in publishing industry–sponsored studies through education and creation of a discussion forum among industry research sponsors and biomedical journals.12,13 In 2010, the MPIP convened a roundtable of 23 journal editors and industry representatives (see the “Acknowledgments” section for a list of MPIP participants) to characterize the persistent and perceived credibility gap in industry-sponsored research and identify approaches to resolve it. Attendees agreed that there have been important improvements in the conduct and reporting of industry-sponsored studies during the past 5 years, but several opportunities remain for additional improvement. Attendees reached consensus on a top 10 list of recommendations (Table), intended to serve as a call to action for all stakeholders—authors, journal editors, research sponsors, and others—to enhance the quality and transparency of industry-sponsored clinical research reporting. Although framed in the context of industry sponsorship, many of these recommendations would enhance the credibility of clinical research publications in general, regardless of the funding source.
TABLE
TABLE
Top 10 Recommendations for Closing the Credibility Gap in Reporting Industry-Sponsored Clinical Research
Many perceive a mismatch between the research hypotheses of some industry-sponsored studies and the needs of the public and practicing clinicians to improve patient health. The best way to elevate the credibility of industry-sponsored clinical research is to ensure that such research is designed to answer important clinical and scientific questions while respecting regulatory requirements that may influence certain aspects of study design. Credibility is compromised when clinical research is intended for marketing purposes rather than advancing scientific and medical knowledge. Sponsors could enhance transparency and credibility by better explaining to journals,14 the biomedical community, and the public the decision-making process underlying the research endeavor. For example, sponsors could be more transparent in describing how external input and involvement from the academic community were obtained to inform study design (eg, by acknowledging participants in protocol development, advisory boards, and other roles).
Many industry sponsors have committed to disclosing the results of all clinical studies through recognized trial registries. Complete and transparent disclosure is required by law in many regions, fulfills the ethical obligation to trial participants, and is critical to the advancement of science. The ability to cross-reference trial registries, results databases, and all related publications informs the scientific community whether studies are completed or are under way and discourages selective reporting. Several recent articles have highlighted that there is a persistent need for better disclosure of clinical trial results, irrespective of study sponsorship.15-17
Whereas results from well-designed studies that are negative, confirmatory, inconclusive, or less immediately relevant to practicing clinicians can be particularly challenging to publish, these manuscripts can contribute toward the progress of science, may open the door for future research, and can prevent redundancy. Sponsors and authors should strive to disseminate them in appropriate venues, provided the data are put in context and the study limitations are clearly stated. This may require editors and publishers to explore and implement novel publication approaches well suited to these sorts of reports. Some possible approaches could include journals dedicated to these studies (perhaps in open-access format), abridged article formats more suitable to them, and/or specific reviewing mechanisms focused on scientific validity as opposed to “impact.” Many of these potential solutions are currently being explored and developed by journals and publishers.12 Finally, sponsors and authors should avoid redundant or duplicate publications. As part of this effort, sponsors could support editors' educational efforts to combat plagiarism.18
Recent advances by academia, journals, and organizations such as the Institute of Medicine and ICMJE have improved processes for disclosing authors' potential conflicts of interest. Consensus among journal editors remains elusive on some specifics, such as the time frame for the reporting period and minimum amounts for financial reporting. These debates notwithstanding, however, editors and sponsors should support the use of the updated ICMJE Conflict of Interest Reporting Form19 and continue dialogue regarding its improvement. Furthermore, the same conflict of interest reporting standards should be applied uniformly to all authors, regardless of the source of research funding.20
To further enhance disclosure transparency and reduce the administrative burden on authors, all parties should also explore the feasibility of developing a centralized, publicly accessible disclosure database.21 Specific issues that need to be addressed include responsibility for quality control and maintenance, privacy/public data access issues, data ownership, and database funding. If these issues could be resolved, a digital database would provide an efficient and effective means of promoting transparent reporting.
Ineffective or inappropriate reporting can diminish the value and credibility of clinical research. Authors who are well versed in study design, conduct, and analysis may lack formal writing training or knowledge of reporting guidelines such as the Consolidated Standards of Reporting Trials (CONSORT) requirements.22 The experiences of editors and industry publication professionals suggest there is a large “information gap” in this regard, particularly related to authors' knowledge of key aspects of authorship that directly affect the quality and credibility of submitted manuscripts.
Journals and research sponsors should collaborate to educate researchers and other groups who conduct or contribute to publication development, whether they work in industry, academia, or other venues. Best practice guides should be widely disseminated to industry and academic authors. For example, the MPIP's Authors' Submission Toolkit23 can help authors navigate the manuscript development and submission process, and EQUATOR's author resource library can provide guidance on research reporting.24 On the basis of author and editor feedback, additional materials or educational programs may be needed to supplement existing guidelines; editors and industry representatives should collaborate to identify specific areas of unmet need and develop educational resources to address them. Finally, editors have an additional opportunity and responsibility to expand their academic educational efforts and drive education within and among journals to encourage the harmonization of editorial policies and reviewer standards in line with evolving best practices.
Research sponsors have improved their credibility significantly by incorporating into their policies and standard practices5-10 definitions of authorship and contributorship developed by ICMJE, the American Medical Writers Association, the European Medical Writers Association, and other professional bodies. Importantly, these definitions explicitly recognize the positive role that professional writers can play in manuscript development, provided they are appropriately acknowledged as authors or contributors (in accordance with ICMJE guidelines) and their names, affiliations, and potential conflicts of interest are disclosed.25
All parties must continue to work toward zero tolerance of ghostwriting (defined as failure to acknowledge individuals who helped write the paper) and guest authorship (defined as inclusion of individuals as authors who do not qualify because they do no meet ICMJE or journal criteria for authorship). Sponsors should ensure that employees' contributions are fully disclosed, using the same standards for employees and nonemployees. Such disclosure should be done without applying quotas of the maximum number of industry-employed authors or prespecified ratios of industry-employed to independent authors that would inappropriately exclude individuals who qualify for authorship or acknowledgment. For their part, journals need to eliminate any biases against manuscripts that have industry authors. Finally, sponsors, academic institutions, and editors should reinforce collaboratively the unacceptability of ghostwriting and guest authorship.
There is an unmet need for better and more uniform reporting of adverse events. Although “no clinically significant adverse events” and “no unexpected adverse events” are common shorthand in journal articles, such phrases lack clinical relevance, particularly regarding rare adverse events that may be important for agents used over a long period in large populations. Editors, sponsors, and clinicians would benefit from consensus on more uniform reporting guidelines that clearly specify the type and format of adverse event data provided in the manuscript and/or supplemental material.26 In addition, journals may need to revisit their manuscript length policies if they wish this information to be present in the main document.
Finally, editors and sponsors must educate authors on the need to balance the strength of adverse event claims vs the features and limitations of trial design appropriately. In a study that is not powered to assess rare adverse events, it is more appropriate to qualify the findings (eg, “additional severe adverse events were not detected in this short, small trial”) than to make broad statements that could mislead readers (eg, “generally safe and well tolerated”).
Some journals request submission of a clinical study protocol to validate methods and end points used in submitted manuscripts, screen for analysis or reporting errors, confirm that the manuscript matches the protocol, and verify that any protocol amendments do not affect study conduct or integrity inappropriately.27 In addition, several journals post online complete protocols or excerpts together with the published manuscript to provide greater transparency and additional context to readers. Journals should describe their protocol submission requirements and publication policies in their instructions for authors and apply them irrespective of study sponsorship.
Public dissemination of protocols by journals raises several practical issues that require further discussion. To foster development of effective policies on protocol disclosure, sponsors should engage with journals on the appropriate format and organization and the extent and legitimacy of redactions to protect proprietary intellectual property or other concerns. In addition, because study protocols are frequently amended as research progresses, disclosure of different versions in multiple public venues may create confusion and redundancy. Stakeholders should explore whether a single repository is feasible and meets the objective of transparency.
Most journals assess statistical methods as a routine part of the peer review process, often relying on established reporting guidelines such as CONSORT.22 Sponsors should ensure that authors provide adequate information about the chosen methods based on the prespecified study design and parameters, and how they were applied to the final data set. To enhance credibility, authors need to adhere to existing reporting standards, and editors have a responsibility to uniformly enforce these requirements at their journals.
The issue of statistical analysis credibility warrants further discussion among editors, authors, and research sponsors to explore how journals can develop policies that raise standards for all clinical publications, independent of the financial support or authorship. Singling out industry-sponsored trials for additional statistical validation28 unfairly implies that these studies' analyses are inherently deficient and deserve heightened scrutiny.
The credibility of industry-sponsored research is threatened when authors cannot explain or defend key details of study design and analysis or verify access to raw data. Sponsors' letters of agreements with authors should clearly define authors' data access rights and expectations and their responsibility to understand and attest to them if required by journals. Industry sponsors need internal policies and procedures that facilitate data access for investigators and authors, and journals should unambiguously state their submission and publication policies on data access. Journals and sponsors should consider that data access needs may also differ, depending on study type. For example, the level of data access expected and feasible for all authors may not be the same for a noninterventional study as for a multicenter interventional trial.
The MPIP's Authors' Submission Toolkit advises authors, when submitting a rejected manuscript to another journal, to explore the possibility of providing a copy of the prior manuscript version and reviewers' comments to demonstrate that suggestions have been incorporated.23 Although the practice is not uniformly accepted at this time, some journals encourage the sharing of prior reviews on the grounds that it elevates transparency, avoids duplicated efforts, and increases the quality of subsequent submissions.
Given that there is no consensus among editors on whether to accept prior reviews, this decision should be made by individual journals. Those journals that accept prior reviews must articulate their policies clearly and instruct their peer reviewers on how best to use them, and authors must be educated about how journals integrate prior reviews into their decision-making processes.
These top 10 recommendations outline several opportunities to enhance the transparency and credibility of industry-sponsored clinical research. Sponsors must continue to promote best practice guidelines, incorporate them into their policies and processes, and work with other biopharmaceutical and medical device companies and professional organizations to ensure uniform adoption. They should also drive author education efforts by disseminating guidelines and materials. Editors must ensure their policies are clear, transparent, well publicized, and uniformly applied irrespective of author affiliation or study sponsorship, and should increase their collaboration and overall role in promoting best practices.
The MPIP roundtable participants identified several areas of potential collaboration between journals and sponsors. Joint educational activities, such as guideline development (eg, the MPIP's Authors' Submission Toolkit and this document), exemplify collaboration toward the shared goal of reporting high-quality clinical research. Sponsors and editors can also collaborate in ongoing educational activities for authors of sponsored research and should jointly discuss areas of persistent ambiguity to exchange ideas and align on key issues for mutual benefit. Finally, all parties should take the opportunity to extend these efforts toward raising the standards for all research activities, irrespective of industry sponsorship. Such efforts are vital to closing the credibility gap in reporting industry-sponsored clinical research.
Acknowledgments
Approximately 20 invitations to the MPIP roundtable in New York, NY, on November 4, 2010, were extended to senior editors of general medical and specialty journals across various therapeutic areas, including both prior MPIP activity participants and new potential participants, of which 12 were accepted. Participants in the MPIP roundtable were as follows: Vito Brusasco, MD (editor in chief, European Respiratory Journal), Edward Campion, MD (senior deputy editor, New England Journal of Medicine), Juli Clark, PharmD (director, global medical writing, Amgen), Finbarr Cotter, MB, PhD (editor in chief, British Journal of Haematology), Frank S. David, MD, PhD (director, Leerink Swann Consulting), Cynthia Dunbar, MD (editor in chief, Blood), Robert Enck, MD (editor in chief, American Journal of Hospice and Palliative Medicine), Michelle Evangelista, BA (analyst, Leerink Swann Consulting), Lorna Fay (director/team leader, publications management, Pfizer), Rollin Gallagher, MD, MPH (editor in chief, Pain Medicine), John Gonzalez (global skills lead–publications, AstraZeneca), Daniel G. Haller, MD (editor in chief emeritus, Journal of Clinical Oncology), Brian Jenkins (executive supplements editor, Elsevier), Christine Laine, MD, MPH (editor in chief, Annals of Internal Medicine), Delong Liu, MD (editor in chief, Journal of Hematology and Oncology), Elizabeth Loder, MD, MPH (clinical editor, British Medical Journal), Bernadette Mansi (director, medical communications quality and practices, GlaxoSmithKline), Robert Matheis (director, medical communications, evidence-based medicine, sanofi-aventis; president, International Society for Medical Publication Professionals), Charles L. Miller (medical governance information director, GlaxoSmithKline), LaVerne A. Mooney (director, publications management, Pfizer), Jake Olin, BS (associate, Leerink Swann Consulting), Kraig Schulz, MS (managing director, Leerink Swann Consulting), and Maja Zecevic, PhD, MPH (North American senior editor, The Lancet). Participants did not receive honoraria or stipends, but reasonable travel expenses were reimbursed to some on request and reported by the MPIP cosponsors according to their companies' policies and applicable reporting requirements. With the exception of Dr Loder, all authors and roundtable participants affirm that the contents of this article reflect the spirit and substance of the discussion that took place at the meeting.
Tania Goel and Sarah Honig of Leerink Swann Consulting LLC provided writing and research assistance in the preparation of the outline and first draft of the manuscript.
Footnotes
Disclaimer: The views expressed in this article are those of the authors alone and should not be read as representing the position or views of their employers.
Grant Support: The manuscript was developed through the MPIP initiative, which is currently funded by Amgen, AstraZeneca, Bristol-Myers Squibb, GlaxoSmithKline, Johnson & Johnson Pharmaceutical Research & Development, LLC, Merck, Pfizer, and Takeda Pharmaceuticals North America. Bristol-Myers Squibb, Johnson & Johnson Pharmaceutical Research & Development, LLC, Merck, and Takeda Pharmaceuticals North America joined the initiative after the 2010 MPIP roundtable meeting. Project management of the MPIP is provided by Leerink Swann Consulting.
Potential Competing Interests: J.C., J.G. S.G., B.A.M., C.L.M., and L.A.M. are employees of companies that fund MPIP. J.G. and T.M.G. are board members of the International Society of Medical Publication Professionals, which is a cosponsor of the MPIP. F.S.D. is an employee of Leerink Swann Consulting, LLC, a life sciences consultancy that serves a large number of biopharmaceutical, medical technology, tools, and diagnostics companies worldwide and is retained by the MPIP initiative. M.Z. is an employee of Elsevier, the publisher of Mayo Clinic Proceedings. D.G.H. and C.L. have no financial support to disclose.
Dr Gesell is currently with United BioSource–Envision Group, Franklin Lakes, NJ. Dr Haller is currently with Gastrointestinal Cancer Research, Melville, NY.
Supplemental Online Material
Video 1
Author Interview Video
1. Bruyere O., Kanis J.A., Ibar-Abadie M.E. The need for a transparent, ethical, and successful relationship between academic scientists and the pharmaceutical industry: a view of the Group for the Rest of Ethics and Excellent in Science (GREES) Osteopor Int. 2010;21(5):713–722. [PubMed]
2. Pyke S., Julious S.A., Day S. The potential for bias in reporting of industry-sponsored clinical trials. Pharm Stats. 2011;10(1):74–79. [PubMed]
3. Strahlman E., Rockhold F., Freeman A. Public disclosure of clinical research. Lancet. 2009;373(9672):1319–1320. [PubMed]
4. PhRMA Principles on Conduct of Clinical Trials: Communication of Clinical Trial Results. http://www.phrma.org/sites/default/files/105/042009_clinical_trial_principles_final.pdf PhRMA Web site. Accessed January 31, 2012.
5. Amgen Amgen Guidelines for Publications. http://www.amgen.com/about/amgen_guidelines_for_publications.html Amgen Web site. Accessed January 31, 2012.
6. AstraZeneca Transparency of Trial Information. http://www.astrazeneca.com/Responsibility/Research-ethics/Clinical-trials/Transparency-of-trial-information AstraZeneca Web site. Accessed January 31, 2012.
7. GlaxoSmithKline Reports and publications, Public policies, Disclosure of Clinical Trial Information. http://www.gsk.com/reportsandpublications-policies.htm GlaxoSmithKline Web site. Accessed January 31, 2012.
8. Johnson & Johnson Transparency in Our Business Activities. http://www.jnj.com/connect/about-jnj/our-citizenship/transparency-in-our-business-activities/transparency+in+our+business+activities Johnson & Johnson Web site. Accessed January 31, 2012.
9. Merck Merck Guidelines for Publication of Clinical Trials and Related Works. http://www.merck.com/research/discovery-and-development/clinical-development/Merck-Guidelines-for-Publication-of-Clinical-Trials-and-Related-Works.pdf Merck Web site. Accessed January 31, 2012.
10. Pfizer Conducting Ethical Research – Registration, Disclosure, and Authorship. http://www.pfizer.com/research/research_clinical_trials/registration_disclosure_authorship.jsp Pfizer Web site. Accessed January 31, 2012.
11. Angell M. Industry-sponsored clinical research: a broken system. JAMA. 2008;300(9):1069–1071. [PubMed]
12. Clark J., Gonzalez J., Mansi B. Enhancing transparency and efficiency in reporting industry-sponsored clinical research: report from the Medical Publishing Insights and Practices initiative. Int J Clin Pract. 2010;64(8):1028–1033. [PubMed]
13. www.mpip-initiative.org MPIP Web site. Accessed January 31, 2012.
14. Clark S., Horton R. Putting research into context – revisited. Lancet. 2010;376(9734):10–11. [PubMed]
15. Lehman R., Loder E. Missing clinical trial data. BMJ. 2012;344:d8158. [PubMed]
16. Prayle A.P., Hurley M.N., Smyth A.R. Compliance with mandatory reporting of clinical trial results on ClinicalTrials.gov: cross sectional study. BMJ. 2011;344:d7373. [PubMed]
17. Ross J.S., Tse T., Zarin D.A. Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ. 2011;344:d7292. [PubMed]
18. Fighting plagiarism [editorial] Lancet. 2008;371(9631):2146. [PubMed]
19. ICMJE Uniform Requirements for Manuscripts Submitted to Biomedical Journals: Ethical Considerations in the Conduct and Reporting of Research: Conflicts of Interest. www.icmje.org/ethical_4conflicts.html ICMJE Web site. Accessed January 31, 2012.
20. Lanier W.L. Bidirectional conflicts of interest involving industry and medical journals: who will champion integrity? Mayo Clinic Proc. 2009;84(9):771–775. [PMC free article] [PubMed]
21. Steinbrook R. Online disclosure of physician-industry relationships. N Engl J Med. 2009;360(4):325–327. [PubMed]
22. CONSORT The CONSORT statement. www.consort-statement.org/consort-statement CONSORT Web site. Accessed January 31, 2012.
23. Chipperfield L., Citrome L., Clark J. Authors' Submission Toolkit: a practical guide to getting your research published. Curr Med Res Opin. 2010;26(8):1967–1982. [PubMed]
24. EQUATOR Resources for authors of research reports. www.equator-network.org/resource-centre/authors-of-research-reports/authors-of-research-reports EQUATOR Network Web site. Accessed January 31, 2012.
25. Norris R., Bowman A., Fagan J.M. International Society for Medical Publication Professionals (ISMPP) position statement: the role of the professional medical writer. Curr Med Res Opin. 2007;23(8):1837–1840. [PubMed]
26. Ionnidis J.P.A., Evans S.J.W., Gøtzsche P.C. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781–788. [PubMed]
27. Chan A.W. Bias, spin and misreporting: time for full access to trial protocols and results. PLoS Med. 2008;5(11):e230. [PMC free article] [PubMed]
28. Fontanarosa P.B., Flanagin A., DeAngelis C.D. Reporting conflicts of interest, financial aspects of research, and role of sponsors in funded studies. JAMA. 2005;294(1):110–111. [PubMed]
Articles from Mayo Clinic Proceedings are provided here courtesy of
The Mayo Foundation for Medical Education and Research