Search tips
Search criteria 


Logo of injprevInjury PreventionVisit this articleVisit this journalSubmit a manuscriptReceive email alertsContact usBMJ
Inj Prev. 2007 October; 13(5): 359.
PMCID: PMC2610605

Finding studies for inclusion in systematic reviews of interventions for injury prevention – the importance of grey and unpublished literature

The inclusion of unpublished and grey literature is essential for minimizing the potential effects of publication bias. It is well known that published studies can not be assumed to be an accurate representation of the whole evidence base, as studies that show statistically significant, “positive” results are more likely to be published than those that do not.1 Consequently, if systematic reviews are limited to published studies, they risk excluding vital evidence and yielding inaccurate results, which are likely to be biased to positive results.2 Previous research has indicated that meta‐analyses that exclude grey literature can lead to exaggerated estimates of intervention effects.3,4

It is therefore considered essential that active and extensive searching for unpublished and grey literature is undertaken as part of the review process for all CIG reviews, although we feel this to be particularly important for reviews of injury prevention interventions.

In comparison to reviews covering other aspects of the CIG's scope, we have found that the CIG's injury prevention reviews have a higher proportion of included studies sourced from the grey and unpublished literature. In issue 3, 2007, of the Cochrane Database of Systematic Reviews, there are 24 reviews of interventions for injury prevention published by the CIG. These reviews examine a total of 481 included studies, with 137 (28.5%) of these having originated from the grey or unpublished literature. The percentage of such included studies ranges from zero to 85%, with six5,6,7,8,9,10 having more than 50% of their included studies sourced from grey or unpublished literature: these six are all reviews of interventions for preventing road traffic crashes.

The above figures highlight that there is a substantial amount of injury prevention research located in the grey and unpublished literature, which is never formally published. Therefore, it is vital that review authors are proactive in their efforts to identify and obtain such research reports. However, identifying and obtaining reports on studies that have been completed, but never published, is extremely challenging. There are a number of research data sources that we advise our authors to explore, in addition to the standard bibliographic database searching, in an attempt to identify unpublished reports.

  • Cochrane Central Register of Controlled Trials (CENTRAL). CENTRAL is the most comprehensive source of records related to controlled trials, and is searched for each Cochrane review. It incorporates not only records for controlled trials that have been downloaded from bibliographic databases, but it also includes records of unpublished studies identified through other means, such as handsearching.
  • Handsearching. This is the manual page‐by‐page examination of the entire contents of a publication to identify all eligible reports of studies. It is generally limited to journal issues and conference proceedings collections, which include multiple individual reports or abstracts of studies that may not be adequately indexed elsewhere.
  • Databases of unpublished and ongoing studies. These are databases specifically containing grey literature, such as Zetoc (, which indexes conference proceedings. Additionally, there are a number of registers of ongoing studies, including TrialsCentral™ ( and Current Controlled Trials (www.controlled‐
  • Internet. With the increasing availability of reports and official documents on the Internet, searching for these documents is now easier, although full texts are not always available. Using a well thought‐out search string on search engines such as Google ( and Google Scholar (, authors can identify both published and unpublished research reports. Authors can also target the websites of relevant organizations, which often have their own online, searchable publications library.
  • Reference lists. Further studies can be identified by checking the reference lists of other eligible studies. The reference lists of any previous literature reviews can be particularly helpful for any further potentially relevant studies.
  • Contact with experts. It can sometimes be worthwhile to contact experts in the field who are familiar with the literature and who might be able to advise review authors of any unpublished studies of which they are aware.

Despite a review team's greatest efforts to identify all relevant unpublished and published studies, the possibility of the presence of publication bias can never be dismissed. We would, therefore, suggest that authors make an effort to measure the extent to which publication bias may be present in their review, such as by examining funnel plots.

The full text of all of the CIG's injury prevention reviews are published in the Cochrane Database of Systematic Reviews ( For further information about the work of the CIG, visit www.cochrane‐


1. Dickersin K. How important is publication bias? A synthesis of available data. AIDS Educ Prev 1997. 9(Suppl A)15–21.21 [PubMed]
2. Alderson P, Green S, eds. The Cochrane Collaboration open learning material. 2002. http://www.cochrane‐ (accessed 10 August 2007)
3. McAuley L, Pham Ba', Tugwell P. et al Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta‐analyses? Lancet 2000. 3561228–1231.1231 [PubMed]
4. Hopewell S, McDonald S, Clarke M. et al Grey literature in meta‐analyses of randomized trials of health care interventions. Cochrane Database of Systematic Reviews 2007; Issue 2. Art. No: MR000010, doi: 10.1002/14651858.MR000010.pub3 [PubMed]
5. Willis C, Lybrand S, Bellamy N. Alcohol ignition interlock programmes for reducing drink driving recidivism. Cochrane Database of Systematic Reviews 2004; Issue 3. Art. No: CD004168, doi: 10.1002/14651858.CD004168.pub2 [PubMed]
6. Bunn F, Collier T, Frost C. et al Area‐wide traffic calming for preventing traffic related injuries. Cochrane Database of Systematic Reviews 2003; Issue 1. Art. No: CD003110, doi: 10.1002/14651858.CD003110 [PubMed]
7. Hartling L, Wiebe N, Russell K. et al Graduated driver licensing for reducing motor vehicle crashes among young drivers. Cochrane Database of Systematic Reviews 2004; Issue 2. Art. No: CD003300, doi: 10.1002/14651858.CD003300.pub2 [PubMed]
8. Aeron‐Thomas A S, Hess S. Red‐light cameras for the prevention of road traffic crashes. Cochrane Database of Systematic Reviews 2005; Issue 2. Art. No: CD003862, doi: 10.1002/14651858.CD003862.pub2 [PubMed]
9. Roberts I, Kwan I and the Cochrane Injuries Group Driver Education Reviewers School‐based driver education for the prevention of traffic crashes. Cochrane Database of Systematic Reviews 2001; Issue 3. Art. No: CD003201, doi: 10.1002/14651858.CD003201 [PubMed]
10. Wilson C, Willis C, Hendrikz J K. et al Speed enforcement detection devices for preventing road traffic injuries. Cochrane Database of Systematic Reviews 2006; Issue 2. Art. No: CD004607, doi: 10.1002/14651858.CD004607.pub2 [PubMed]

Articles from Injury Prevention are provided here courtesy of BMJ Publishing Group