Search tips
Search criteria 


Logo of canfamphysLink to Publisher's site
Can Fam Physician. 1995 August; 41: 1356–1360.
PMCID: PMC2146347

Comprehensiveness and bias in reporting clinical trials. Study of reviews of pneumococcal vaccine effectiveness.


PURPOSE: To assess the extent to which relevant controlled clinical trials are cited and summarized in review articles, and to determine whether citation of relevant clinical trails is biased as to study results. DATA SOURCES: Articles were identified by searching MEDLINE and EMBASE databases. STUDY SELECTION: Review articles published between 1986 and 1988 on the clinical effectiveness of pneumococcal vaccine. DATA EXTRACTION: Proportion of relevant clinical trials cited and whether citation is biased by study results. DATA SYNTHESIS: The proportion of relevant primary studies cited per review article ranged from 0% to 36% (mean 9%). The number of trials cited per review ranged from zero to six (mean 1.2). In nine of 17 reviews, no clinical trials were cited. Study populations and outcome(s) were specified and results presented quantitatively for 0 to 27% of relevant trials per review (mean 6%). Unsupportive trials were almost twice as likely to be cited as supportive trials. CONCLUSIONS: Reporting of the results of relevant clinical trials in reviews of pneumococcal vaccine effectiveness is incomplete. Our findings suggest a need for greater scientific rigour in preparing, reviewing, and editing review articles.

Full text

Full text is available as a scanned copy of the original print version. Get a printable copy (PDF file) of the complete article (784K), or click on a page image below to browse page by page. Links to PubMed are also available for Selected References.

Selected References

These references are in PubMed. This may not be the complete list of references from this article.
  • Mulrow CD. The medical review article: state of the science. Ann Intern Med. 1987 Mar;106(3):485–488. [PubMed]
  • Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Meta-analyses of randomized controlled trials. N Engl J Med. 1987 Feb 19;316(8):450–455. [PubMed]
  • Silagy CA. An analysis of review articles published in primary care journals. Fam Pract. 1993 Sep;10(3):337–341. [PubMed]
  • Gøtzsche PC. Reference bias in reports of drug trials. Br Med J (Clin Res Ed) 1987 Sep 12;295(6599):654–656. [PMC free article] [PubMed]
  • Ravnskov U. Cholesterol lowering trials in coronary heart disease: frequency of citation and outcome. BMJ. 1992 Jul 4;305(6844):15–19. [PMC free article] [PubMed]
  • Austrian R. Pneumococcal pneumonia. Diagnostic, epidemiologic, therapeutic and prophylactic considerations. Chest. 1986 Nov;90(5):738–743. [PubMed]
  • Broome CV. Use of bacterial vaccines for prevention of pneumococcal and meningococcal disease in the day care setting. Rev Infect Dis. 1986 Jul-Aug;8(4):584–588. [PubMed]
  • Fedson DS. Adult immunization: protocols and problems. Hosp Pract (Off Ed) 1986 Jul 15;21(7):143–158. [PubMed]
  • Robbins FC, Robbins JB. Current status and prospects for some improved and new bacterial vaccines. Annu Rev Public Health. 1986;7:105–125. [PubMed]
  • Bentley DW. Immunizations in the elderly. Bull N Y Acad Med. 1987 Jul-Aug;63(6):533–551. [PubMed]
  • Fedson DS. Influenza and pneumococcal immunization strategies for physicians. Chest. 1987 Mar;91(3):436–443. [PubMed]
  • Kramer MR, Rudensky B, Hadas-Halperin I, Isacsohn M, Melzer E. Pneumococcal bacteremia--no change in mortality in 30 years: analysis of 104 cases and review of the literature. Isr J Med Sci. 1987 Mar;23(3):174–180. [PubMed]
  • LaForce FM. Pneumonia--1987: new developments. Eur J Clin Microbiol. 1987 Dec;6(6):613–617. [PubMed]
  • Niederman MS. Strategies for the prevention of pneumonia. Clin Chest Med. 1987 Sep;8(3):543–556. [PubMed]
  • Stansfield SK. Acute respiratory infections in the developing world: strategies for prevention, treatment and control. Pediatr Infect Dis J. 1987 Jul;6(7):622–629. [PubMed]
  • Davies AJ, Kumaratne DS. The continuing problem of pneumococcal infection. J Antimicrob Chemother. 1988 Apr;21(4):387–391. [PubMed]
  • Kafidi KT, Rotschafer JC. Bacterial vaccines for splenectomized patients. Drug Intell Clin Pharm. 1988 Mar;22(3):192–197. [PubMed]
  • Williams WW, Hickson MA, Kane MA, Kendal AP, Spika JS, Hinman AR. Immunization policies and vaccine coverage among adults. The risk for missed opportunities. Ann Intern Med. 1988 Apr;108(4):616–625. [PubMed]
  • Oxman AD, Guyatt GH. Guidelines for reading literature reviews. CMAJ. 1988 Apr 15;138(8):697–703. [PMC free article] [PubMed]
  • Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992 Jul 8;268(2):240–248. [PubMed]

Articles from Canadian Family Physician are provided here courtesy of College of Family Physicians of Canada